[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:23:17 dist-test-slave-2w3w krb5kdc[8223](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:23:17 dist-test-slave-2w3w krb5kdc[8223](info): set up 2 sockets
Aug 09 03:23:17 dist-test-slave-2w3w krb5kdc[8223](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 03:23:18.685961 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.232s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:23:18 dist-test-slave-2w3w krb5kdc[8223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:23:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:23:18.809949 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:36143
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:34207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:36143
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:18.894160 8236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:18.894356 8236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:18.894377 8236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:18.895495 8236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:18.895531 8236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:18.895545 8236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:18.895558 8236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:18.895570 8236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:23:18.897156 8236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:34207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:36143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:36143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:18.897464 8236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:18.897666 8236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 03:23:18.903805 8236 server_base.cc:1034] running on GCE node
W20260809 03:23:18.903841 8242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:18.904686 8246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:18.905074 8243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:18.905413 8236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:18.905843 8236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:18.907024 8236 hybrid_clock.cc:648] HybridClock initialized: now 1786245798907001 us; error 36 us; skew 500 ppm
Aug 09 03:23:18 dist-test-slave-2w3w krb5kdc[8223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245798, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:18.909682 8236 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:23:18.910331 8236 webserver.cc:460] Webserver started at http://127.8.5.254:44791/ using document root <none> and password file <none>
I20260809 03:23:18.910622 8236 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:18.910698 8236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:18.910897 8236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:18.912066 8236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "13d808afddc44746bf4142f531512a56"
format_stamp: "Formatted at 2026-08-09 03:23:18 on dist-test-slave-2w3w"
server_key: "dad9243e3ea647d001c83c9a9108f0f3"
server_key_iv: "1f9b5b82c2a8316d35d5fc61aa17278d"
server_key_version: "encryptionkey@0"
I20260809 03:23:18.912474 8236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "13d808afddc44746bf4142f531512a56"
format_stamp: "Formatted at 2026-08-09 03:23:18 on dist-test-slave-2w3w"
server_key: "dad9243e3ea647d001c83c9a9108f0f3"
server_key_iv: "1f9b5b82c2a8316d35d5fc61aa17278d"
server_key_version: "encryptionkey@0"
I20260809 03:23:18.914310 8236 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 03:23:18.915388 8253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:18.915681 8236 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:18.915766 8236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "13d808afddc44746bf4142f531512a56"
format_stamp: "Formatted at 2026-08-09 03:23:18 on dist-test-slave-2w3w"
server_key: "dad9243e3ea647d001c83c9a9108f0f3"
server_key_iv: "1f9b5b82c2a8316d35d5fc61aa17278d"
server_key_version: "encryptionkey@0"
I20260809 03:23:18.915827 8236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:18.926433 8236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:18.928680 8236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:18.928825 8236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:18.933681 8236 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:36143
I20260809 03:23:18.933799 8306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:36143 every 8 connection(s)
I20260809 03:23:18.934361 8236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:18.934713 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 8236
I20260809 03:23:18.934867 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:23:18.935676 8215 external_mini_cluster.cc:1428] Setting key f0f30e14148c6dfa2be216b0bb22dad9
I20260809 03:23:18.935985 8307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:18.940653 8307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56: Bootstrap starting.
I20260809 03:23:18.942387 8307 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:18.943282 8307 log.cc:824] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:18.944370 8307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56: No bootstrap required, opened a new log
I20260809 03:23:18.948989 8307 raft_consensus.cc:348] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13d808afddc44746bf4142f531512a56" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 36143 } }
I20260809 03:23:18.949141 8307 raft_consensus.cc:374] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:18.949214 8307 raft_consensus.cc:729] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d808afddc44746bf4142f531512a56, State: Initialized, Role: FOLLOWER
I20260809 03:23:18.949406 8307 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13d808afddc44746bf4142f531512a56" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 36143 } }
I20260809 03:23:18.949560 8307 raft_consensus.cc:388] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:18.949610 8307 raft_consensus.cc:482] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:18.949663 8307 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:18.950510 8307 raft_consensus.cc:504] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13d808afddc44746bf4142f531512a56" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 36143 } }
I20260809 03:23:18.950704 8307 leader_election.cc:302] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 13d808afddc44746bf4142f531512a56; no voters:
I20260809 03:23:18.950949 8307 leader_election.cc:288] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:23:18.951054 8312 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:18.951359 8312 raft_consensus.cc:686] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56 [term 1 LEADER]: Becoming Leader. State: Replica: 13d808afddc44746bf4142f531512a56, State: Running, Role: LEADER
I20260809 03:23:18.951514 8312 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13d808afddc44746bf4142f531512a56" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 36143 } }
I20260809 03:23:18.951579 8307 sys_catalog.cc:564] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:18.952028 8312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13d808afddc44746bf4142f531512a56. Latest consensus state: current_term: 1 leader_uuid: "13d808afddc44746bf4142f531512a56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13d808afddc44746bf4142f531512a56" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 36143 } } }
I20260809 03:23:18.952107 8312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:18.952047 8315 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "13d808afddc44746bf4142f531512a56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13d808afddc44746bf4142f531512a56" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 36143 } } }
I20260809 03:23:18.952351 8315 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56 [sys.catalog]: This master's current role is: LEADER
Aug 09 03:23:18 dist-test-slave-2w3w krb5kdc[8223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:18.953527 8318 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:18.955291 8318 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:18.958236 8318 catalog_manager.cc:1347] Generated new cluster ID: ff37b6a593174cf391c6f319f2615a27
I20260809 03:23:18.958289 8318 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:23:18.959741 8310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:18.936967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51310 (local address 127.8.5.254:36143)
0809 03:23:18.937510 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:18.937521 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:18.937707 (+ 186us) server_negotiation.cc:407] Connection header received
0809 03:23:18.941578 (+ 3871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:18.941597 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:18.941736 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:18.941966 (+ 230us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:18.944090 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:18.946503 (+ 2413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:18.947686 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:18.948535 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:18.948694 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:18.953838 (+ 5144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:18.953852 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:18.953853 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:18.953866 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:18.956975 (+ 3109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:18.957490 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:18.957493 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:18.957494 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:18.957583 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:18.957950 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:18.957951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:18.957951 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:18.958345 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:18.958618 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:18.959291 (+ 673us) server_negotiation.cc:299] Negotiation successful
0809 03:23:18.959469 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":258,"threads_started":1}
I20260809 03:23:18.968361 8318 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:23:18.969342 8318 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:18.976462 8318 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 13d808afddc44746bf4142f531512a56: Generated new TSK 0
I20260809 03:23:18.976675 8318 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
I20260809 03:23:19.010721 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:36143
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:34207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:19.117775 8335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:19.118005 8335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:19.118046 8335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:19.119422 8335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:19.119509 8335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:19.119557 8335 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:23:19.121121 8335 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:34207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:36143
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:19.121434 8335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:19.121673 8335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:19.127193 8341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:19.127223 8344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:19.127465 8342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:19.127765 8335 server_base.cc:1034] running on GCE node
I20260809 03:23:19.127965 8335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:19.128252 8335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:19.129451 8335 hybrid_clock.cc:648] HybridClock initialized: now 1786245799129435 us; error 42 us; skew 500 ppm
Aug 09 03:23:19 dist-test-slave-2w3w krb5kdc[8223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245799, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:19.133311 8335 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:23:19.133800 8335 webserver.cc:460] Webserver started at http://127.8.5.193:33125/ using document root <none> and password file <none>
I20260809 03:23:19.134063 8335 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:19.134133 8335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:19.134284 8335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:19.135412 8335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "94da007353a847de966d392308d5770f"
format_stamp: "Formatted at 2026-08-09 03:23:19 on dist-test-slave-2w3w"
server_key: "199cb964b09582ccc3d0d824a0b06e4a"
server_key_iv: "4329e44d182d2449604262327d212202"
server_key_version: "encryptionkey@0"
I20260809 03:23:19.135776 8335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "94da007353a847de966d392308d5770f"
format_stamp: "Formatted at 2026-08-09 03:23:19 on dist-test-slave-2w3w"
server_key: "199cb964b09582ccc3d0d824a0b06e4a"
server_key_iv: "4329e44d182d2449604262327d212202"
server_key_version: "encryptionkey@0"
I20260809 03:23:19.137578 8335 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 03:23:19.138631 8351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:19.138916 8335 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:19.139038 8335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "94da007353a847de966d392308d5770f"
format_stamp: "Formatted at 2026-08-09 03:23:19 on dist-test-slave-2w3w"
server_key: "199cb964b09582ccc3d0d824a0b06e4a"
server_key_iv: "4329e44d182d2449604262327d212202"
server_key_version: "encryptionkey@0"
I20260809 03:23:19.139170 8335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:19.154798 8335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:19.157109 8335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:19.157220 8335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:19.157457 8335 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:19.157783 8335 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:19.157855 8335 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:19.157878 8335 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:19.157891 8335 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:19.165380 8335 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:38397
I20260809 03:23:19.165436 8469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:38397 every 8 connection(s)
I20260809 03:23:19.165792 8335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:23:19.167054 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 8335
I20260809 03:23:19.167196 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:23:19.167393 8215 external_mini_cluster.cc:1428] Setting key 33b6934e9abfa8e6e9faf20e8a9a4460
Aug 09 03:23:19 dist-test-slave-2w3w krb5kdc[8223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245799, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:19.177727 8310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:19.166740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:34801 (local address 127.8.5.254:36143)
0809 03:23:19.166799 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:19.166802 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:19.167197 (+ 395us) server_negotiation.cc:407] Connection header received
0809 03:23:19.168127 (+ 930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:19.168128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:19.168139 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:19.168187 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:19.169957 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:19.170469 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:19.171606 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:19.171829 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:19.171922 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:19.174657 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:19.174658 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:19.174659 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:19.174666 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:19.176169 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:19.176668 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:19.176668 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:19.176669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:19.176723 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:19.177035 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:19.177036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:19.177036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:19.177140 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:19.177194 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:19.177586 (+ 392us) server_negotiation.cc:299] Negotiation successful
0809 03:23:19.177660 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 03:23:19.178141 8472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:19.166696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:36143 (local address 127.8.5.193:34801)
0809 03:23:19.166949 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:19.167020 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:19.168029 (+ 1009us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:19.168252 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:19.168256 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:19.169303 (+ 1047us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:19.169806 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:19.169812 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:19.170579 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:19.170580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:19.171508 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:19.171511 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:19.171935 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:19.171936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:19.172075 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:19.172663 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:19.172672 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:19.174562 (+ 1890us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:19.176257 (+ 1695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:19.176264 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:19.176267 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:19.176581 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:19.176800 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:19.176801 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:19.176801 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:19.176961 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:19.177217 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:19.177224 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:19.177417 (+ 193us) client_negotiation.cc:769] Sending connection context
0809 03:23:19.177569 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 03:23:19.177779 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":76,"threads_started":1}
WARNING: no policy specified for kudu/127.8.5.194@KRBTEST.COM; defaulting to no policy
I20260809 03:23:19.178803 8470 heartbeater.cc:347] Connected to a master server at 127.8.5.254:36143
I20260809 03:23:19.178916 8470 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:19.179132 8470 heartbeater.cc:511] Master 127.8.5.254:36143 requested a full tablet report, sending...
I20260809 03:23:19.180042 8270 ts_manager.cc:194] Registered new tserver with Master: 94da007353a847de966d392308d5770f (127.8.5.193:38397)
I20260809 03:23:19.180897 8270 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:34801
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
I20260809 03:23:19.197059 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:36143
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:34207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:19.305761 8475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:19.305963 8475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:19.305989 8475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:19.307168 8475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:19.307209 8475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:19.307242 8475 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:23:19.308719 8475 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:34207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:36143
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8475
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:19.308904 8475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:19.309077 8475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:19.315167 8485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:19.315203 8483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:19.315212 8482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:19.315258 8475 server_base.cc:1034] running on GCE node
I20260809 03:23:19.315488 8475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:19.315691 8475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:19.316828 8475 hybrid_clock.cc:648] HybridClock initialized: now 1786245799316823 us; error 41 us; skew 500 ppm
Aug 09 03:23:19 dist-test-slave-2w3w krb5kdc[8223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245799, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:19.324958 8475 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:23:19.325474 8475 webserver.cc:460] Webserver started at http://127.8.5.194:42119/ using document root <none> and password file <none>
I20260809 03:23:19.325668 8475 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:19.325709 8475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:19.325804 8475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:19.326836 8475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "2a6572250a994364b204086d8bc0b558"
format_stamp: "Formatted at 2026-08-09 03:23:19 on dist-test-slave-2w3w"
server_key: "f9492115c83ac07a62d7f5aa5068774b"
server_key_iv: "f3594843ab604d715eaf42d5d5f7f714"
server_key_version: "encryptionkey@0"
I20260809 03:23:19.327234 8475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "2a6572250a994364b204086d8bc0b558"
format_stamp: "Formatted at 2026-08-09 03:23:19 on dist-test-slave-2w3w"
server_key: "f9492115c83ac07a62d7f5aa5068774b"
server_key_iv: "f3594843ab604d715eaf42d5d5f7f714"
server_key_version: "encryptionkey@0"
I20260809 03:23:19.328606 8475 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:19.329501 8493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:19.329666 8475 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:19.329756 8475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "2a6572250a994364b204086d8bc0b558"
format_stamp: "Formatted at 2026-08-09 03:23:19 on dist-test-slave-2w3w"
server_key: "f9492115c83ac07a62d7f5aa5068774b"
server_key_iv: "f3594843ab604d715eaf42d5d5f7f714"
server_key_version: "encryptionkey@0"
I20260809 03:23:19.329811 8475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:19.340065 8475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:19.343331 8475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:19.343560 8475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:19.343955 8475 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:19.344379 8475 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:19.344431 8475 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:19.344471 8475 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:19.344508 8475 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:19.361938 8475 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:36575
I20260809 03:23:19.362004 8610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:36575 every 8 connection(s)
I20260809 03:23:19.362479 8475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:23:19.362928 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 8475
I20260809 03:23:19.363063 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:23:19.363268 8215 external_mini_cluster.cc:1428] Setting key d3630b3fe210ea5048fddf807a425d61
Aug 09 03:23:19 dist-test-slave-2w3w krb5kdc[8223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245799, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:19.375846 8310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:19.363707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:35475 (local address 127.8.5.254:36143)
0809 03:23:19.363786 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:19.363788 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:19.363799 (+ 11us) server_negotiation.cc:407] Connection header received
0809 03:23:19.364793 (+ 994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:19.364794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:19.364805 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:19.364885 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:19.365937 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:19.366713 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:19.368940 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:19.369299 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:19.369406 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:19.372427 (+ 3021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:19.372428 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:19.372428 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:19.372436 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:19.374191 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:19.374728 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:19.374729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:19.374730 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:19.374816 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:19.375141 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:19.375142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:19.375142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:19.375264 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:19.375352 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:19.375666 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 03:23:19.375757 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
WARNING: no policy specified for kudu/127.8.5.195@KRBTEST.COM; defaulting to no policy
I20260809 03:23:19.376324 8613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:19.363413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:36143 (local address 127.8.5.194:35475)
0809 03:23:19.363644 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:19.363693 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:19.364680 (+ 987us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:19.364972 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:19.364978 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:19.365651 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:19.365837 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:19.365842 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:19.366874 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:19.366882 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:19.368778 (+ 1896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:19.368782 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:19.369482 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:19.369483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:19.369646 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:19.370238 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:19.370249 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:19.372283 (+ 2034us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:19.374294 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:19.374301 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:19.374321 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:19.374649 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:19.374895 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:19.374896 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:19.374896 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:19.375063 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:19.375335 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:19.375341 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:19.375515 (+ 174us) client_negotiation.cc:769] Sending connection context
0809 03:23:19.375617 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 03:23:19.375777 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":99,"threads_started":1}
I20260809 03:23:19.376791 8611 heartbeater.cc:347] Connected to a master server at 127.8.5.254:36143
I20260809 03:23:19.376894 8611 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:19.377115 8611 heartbeater.cc:511] Master 127.8.5.254:36143 requested a full tablet report, sending...
I20260809 03:23:19.377521 8270 ts_manager.cc:194] Registered new tserver with Master: 2a6572250a994364b204086d8bc0b558 (127.8.5.194:36575)
I20260809 03:23:19.377924 8270 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:35475
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
I20260809 03:23:19.397974 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:36143
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:34207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:19.506497 8616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:19.506700 8616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:19.506726 8616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:19.507963 8616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:19.508008 8616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:19.508035 8616 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:23:19.509644 8616 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:34207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:36143
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:19.509891 8616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:19.510128 8616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:19.515812 8623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:19.515877 8625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:19.515869 8616 server_base.cc:1034] running on GCE node
W20260809 03:23:19.515816 8622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:19.516227 8616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:19.516434 8616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:19.517597 8616 hybrid_clock.cc:648] HybridClock initialized: now 1786245799517587 us; error 27 us; skew 500 ppm
Aug 09 03:23:19 dist-test-slave-2w3w krb5kdc[8223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245799, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:19.520147 8616 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:23:19.520566 8616 webserver.cc:460] Webserver started at http://127.8.5.195:39239/ using document root <none> and password file <none>
I20260809 03:23:19.520785 8616 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:19.520828 8616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:19.521010 8616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:19.522040 8616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "03229f714b9245c7997511d90814253a"
format_stamp: "Formatted at 2026-08-09 03:23:19 on dist-test-slave-2w3w"
server_key: "041059859ac08445daf7ff492ee45a2d"
server_key_iv: "e6d72cd3563a960d3c05a6de61ccf6a2"
server_key_version: "encryptionkey@0"
I20260809 03:23:19.522408 8616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "03229f714b9245c7997511d90814253a"
format_stamp: "Formatted at 2026-08-09 03:23:19 on dist-test-slave-2w3w"
server_key: "041059859ac08445daf7ff492ee45a2d"
server_key_iv: "e6d72cd3563a960d3c05a6de61ccf6a2"
server_key_version: "encryptionkey@0"
I20260809 03:23:19.524008 8616 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:23:19.524729 8633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:19.524940 8616 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:19.525033 8616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "03229f714b9245c7997511d90814253a"
format_stamp: "Formatted at 2026-08-09 03:23:19 on dist-test-slave-2w3w"
server_key: "041059859ac08445daf7ff492ee45a2d"
server_key_iv: "e6d72cd3563a960d3c05a6de61ccf6a2"
server_key_version: "encryptionkey@0"
I20260809 03:23:19.525107 8616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:19.534166 8616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:19.535989 8616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:19.536142 8616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:19.536360 8616 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:19.536650 8616 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:19.536684 8616 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:19.536705 8616 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:19.536746 8616 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:19.548578 8616 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:42171
I20260809 03:23:19.548661 8753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:42171 every 8 connection(s)
I20260809 03:23:19.549007 8616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:23:19.554453 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 8616
I20260809 03:23:19.554543 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:23:19.554719 8215 external_mini_cluster.cc:1428] Setting key 2e3a73afb0eaae6ff0ddd56304ce7007
Aug 09 03:23:19 dist-test-slave-2w3w krb5kdc[8223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245799, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:19.559090 8310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:19.549781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:46921 (local address 127.8.5.254:36143)
0809 03:23:19.549851 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:19.549853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:19.550253 (+ 400us) server_negotiation.cc:407] Connection header received
0809 03:23:19.550684 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:19.550685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:19.550696 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:19.550754 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:19.551857 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:19.552355 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:19.553518 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:19.553722 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:19.553776 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:19.556396 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:19.556398 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:19.556398 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:19.556406 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:19.557628 (+ 1222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:19.558074 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:19.558076 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:19.558077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:19.558141 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:19.558405 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:19.558406 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:19.558406 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:19.558526 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:19.558601 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:19.558897 (+ 296us) server_negotiation.cc:299] Negotiation successful
0809 03:23:19.558997 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 03:23:19.559381 8756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:19.549769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:36143 (local address 127.8.5.195:46921)
0809 03:23:19.550128 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:19.550162 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:19.550603 (+ 441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:19.550831 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:19.550834 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:19.551541 (+ 707us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:19.551781 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:19.551786 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:19.552432 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:19.552433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:19.553407 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:19.553410 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:19.553797 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:19.553798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:19.553906 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:19.554416 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:19.554426 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:19.556301 (+ 1875us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:19.557740 (+ 1439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:19.557747 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:19.557749 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:19.557979 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:19.558220 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:19.558221 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:19.558221 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:19.558334 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:19.558605 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:19.558611 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:19.558745 (+ 134us) client_negotiation.cc:769] Sending connection context
0809 03:23:19.558869 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 03:23:19.559055 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":279,"threads_started":1}
I20260809 03:23:19.559835 8754 heartbeater.cc:347] Connected to a master server at 127.8.5.254:36143
I20260809 03:23:19.559911 8754 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:19.560040 8754 heartbeater.cc:511] Master 127.8.5.254:36143 requested a full tablet report, sending...
I20260809 03:23:19.560343 8270 ts_manager.cc:194] Registered new tserver with Master: 03229f714b9245c7997511d90814253a (127.8.5.195:42171)
I20260809 03:23:19.560667 8270 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:46921
I20260809 03:23:19.566875 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 03:23:19 dist-test-slave-2w3w krb5kdc[8223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245799, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 03:23:19 dist-test-slave-2w3w krb5kdc[8223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245799, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.5.193@KRBTEST.COM
I20260809 03:23:19.592046 8763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:19.584073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36156 (local address 127.8.5.193:38397)
0809 03:23:19.584290 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:19.584294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:19.584305 (+ 11us) server_negotiation.cc:407] Connection header received
0809 03:23:19.584333 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:19.584334 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:19.584348 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:19.584420 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:19.585069 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:19.585846 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:19.586600 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:19.586919 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:19.587053 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:19.589273 (+ 2220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:19.589280 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:19.589281 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:19.589288 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:19.591035 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:19.591328 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:19.591331 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:19.591331 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:19.591390 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:19.591542 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:19.591542 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:19.591543 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:19.591660 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:19.591805 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:19.591840 (+ 35us) server_negotiation.cc:299] Negotiation successful
0809 03:23:19.591903 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":125,"threads_started":1}
W20260809 03:23:19.592495 8381 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36156
Aug 09 03:23:19 dist-test-slave-2w3w krb5kdc[8223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245799, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 03:23:19 dist-test-slave-2w3w krb5kdc[8223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245799, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.193@KRBTEST.COM
I20260809 03:23:19.615665 8763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:19.608922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36160 (local address 127.8.5.193:38397)
0809 03:23:19.608989 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:19.608996 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:19.609050 (+ 54us) server_negotiation.cc:407] Connection header received
0809 03:23:19.609101 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:19.609102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:19.609114 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:19.609173 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:19.609728 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:19.610218 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:19.610946 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:19.611192 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:19.611245 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:19.613457 (+ 2212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:19.613458 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:19.613458 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:19.613465 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:19.614665 (+ 1200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:19.615055 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:19.615056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:19.615056 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:19.615114 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:19.615282 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:19.615282 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:19.615283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:19.615379 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:19.615469 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:19.615537 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 03:23:19.615600 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 03:23:19.616215 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 8335
I20260809 03:23:19.622742 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 8475
I20260809 03:23:19.630801 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 8616
I20260809 03:23:19.635952 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 8236
2026-08-09T03:23:19Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2209 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:23:19 dist-test-slave-2w3w krb5kdc[8771](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:23:19 dist-test-slave-2w3w krb5kdc[8771](info): set up 2 sockets
Aug 09 03:23:19 dist-test-slave-2w3w krb5kdc[8771](info): commencing operation
krb5kdc: starting...
W20260809 03:23:20.712013 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:23:20 dist-test-slave-2w3w krb5kdc[8771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245800, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:23:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:23:20.833711 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:44541
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:33139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:44541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:20.915071 8785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:20.915284 8785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:20.915328 8785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:20.916451 8785 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:20.916517 8785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:20.916539 8785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:20.916560 8785 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:20.916589 8785 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:23:20.918012 8785 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:33139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:44541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:44541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:20.918282 8785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:20.918530 8785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:20.923280 8793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:20.923286 8791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:20.923316 8790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:20.923481 8785 server_base.cc:1034] running on GCE node
I20260809 03:23:20.923799 8785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:20.924144 8785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:20.925302 8785 hybrid_clock.cc:648] HybridClock initialized: now 1786245800925285 us; error 49 us; skew 500 ppm
Aug 09 03:23:20 dist-test-slave-2w3w krb5kdc[8771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245800, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:20.927809 8785 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:23:20.928171 8785 webserver.cc:460] Webserver started at http://127.8.5.254:42343/ using document root <none> and password file <none>
I20260809 03:23:20.928369 8785 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:20.928409 8785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:20.928553 8785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:20.929522 8785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "7d65c8ee0976434a9c512b8680ed1914"
format_stamp: "Formatted at 2026-08-09 03:23:20 on dist-test-slave-2w3w"
server_key: "a74ef8fa5125df4cc10487a598ac80ad"
server_key_iv: "797a465036303bd79b78c8a5375f2928"
server_key_version: "encryptionkey@0"
I20260809 03:23:20.929801 8785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "7d65c8ee0976434a9c512b8680ed1914"
format_stamp: "Formatted at 2026-08-09 03:23:20 on dist-test-slave-2w3w"
server_key: "a74ef8fa5125df4cc10487a598ac80ad"
server_key_iv: "797a465036303bd79b78c8a5375f2928"
server_key_version: "encryptionkey@0"
I20260809 03:23:20.931094 8785 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:23:20.931787 8801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:20.931944 8785 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:20.932030 8785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "7d65c8ee0976434a9c512b8680ed1914"
format_stamp: "Formatted at 2026-08-09 03:23:20 on dist-test-slave-2w3w"
server_key: "a74ef8fa5125df4cc10487a598ac80ad"
server_key_iv: "797a465036303bd79b78c8a5375f2928"
server_key_version: "encryptionkey@0"
I20260809 03:23:20.932085 8785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:20.948320 8785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:20.950577 8785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:20.950687 8785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:20.954622 8785 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:44541
I20260809 03:23:20.954674 8857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:44541 every 8 connection(s)
I20260809 03:23:20.955097 8785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:20.955998 8858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:20.958220 8858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914: Bootstrap starting.
I20260809 03:23:20.958771 8858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:20.959069 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 8785
I20260809 03:23:20.959138 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:23:20.959177 8858 log.cc:824] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:20.959321 8215 external_mini_cluster.cc:1428] Setting key 8d64d2d07b0ff566eb2ead8fb286aa87
I20260809 03:23:20.960029 8858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914: No bootstrap required, opened a new log
I20260809 03:23:20.962711 8858 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d65c8ee0976434a9c512b8680ed1914" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 44541 } }
I20260809 03:23:20.962899 8858 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:20.962937 8858 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d65c8ee0976434a9c512b8680ed1914, State: Initialized, Role: FOLLOWER
I20260809 03:23:20.963088 8858 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d65c8ee0976434a9c512b8680ed1914" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 44541 } }
I20260809 03:23:20.963201 8858 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:20.963245 8858 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:20.963295 8858 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:20.963873 8858 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d65c8ee0976434a9c512b8680ed1914" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 44541 } }
I20260809 03:23:20.963979 8858 leader_election.cc:302] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d65c8ee0976434a9c512b8680ed1914; no voters:
I20260809 03:23:20.964139 8858 leader_election.cc:288] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:23:20.964231 8863 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:20.964375 8863 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914 [term 1 LEADER]: Becoming Leader. State: Replica: 7d65c8ee0976434a9c512b8680ed1914, State: Running, Role: LEADER
I20260809 03:23:20.964437 8858 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:20.964505 8863 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d65c8ee0976434a9c512b8680ed1914" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 44541 } }
I20260809 03:23:20.964944 8865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d65c8ee0976434a9c512b8680ed1914" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d65c8ee0976434a9c512b8680ed1914" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 44541 } } }
I20260809 03:23:20.965091 8865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:20.965229 8864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d65c8ee0976434a9c512b8680ed1914. Latest consensus state: current_term: 1 leader_uuid: "7d65c8ee0976434a9c512b8680ed1914" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d65c8ee0976434a9c512b8680ed1914" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 44541 } } }
I20260809 03:23:20.965899 8879 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:20.966836 8879 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:20.966097 8864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914 [sys.catalog]: This master's current role is: LEADER
Aug 09 03:23:20 dist-test-slave-2w3w krb5kdc[8771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245800, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:20.968724 8879 catalog_manager.cc:1347] Generated new cluster ID: 90377cee2ed34baeac868b18e3805a8f
I20260809 03:23:20.968813 8879 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:23:20.971411 8862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:20.959857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59234 (local address 127.8.5.254:44541)
0809 03:23:20.960046 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:20.960056 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:20.960089 (+ 33us) server_negotiation.cc:407] Connection header received
0809 03:23:20.960591 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:20.960599 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:20.960660 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:20.960811 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:20.961397 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:20.962908 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:20.963844 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:20.964484 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:20.964599 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:20.967644 (+ 3045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:20.967648 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:20.967648 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:20.967660 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:20.969737 (+ 2077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:20.970134 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:20.970137 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:20.970137 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:20.970248 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:20.970455 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:20.970456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:20.970457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:20.970764 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:20.970934 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:20.971052 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 03:23:20.971194 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":82,"threads_started":1}
I20260809 03:23:20.976368 8879 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:23:20.977176 8879 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:20.981153 8879 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d65c8ee0976434a9c512b8680ed1914: Generated new TSK 0
I20260809 03:23:20.981364 8879 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
I20260809 03:23:21.010373 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:44541
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:33139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:21.095556 8885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:21.095779 8885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:21.095827 8885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:21.096987 8885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:21.097051 8885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:21.097096 8885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:23:21.098548 8885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:33139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:44541
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:21.098809 8885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:21.099095 8885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:21.103896 8893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:21.103907 8890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:21.103966 8891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:21.104256 8885 server_base.cc:1034] running on GCE node
I20260809 03:23:21.104449 8885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:21.104635 8885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:21.105785 8885 hybrid_clock.cc:648] HybridClock initialized: now 1786245801105753 us; error 35 us; skew 500 ppm
Aug 09 03:23:21 dist-test-slave-2w3w krb5kdc[8771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245801, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:21.108322 8885 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:23:21.108760 8885 webserver.cc:460] Webserver started at http://127.8.5.193:43889/ using document root <none> and password file <none>
I20260809 03:23:21.108984 8885 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:21.109053 8885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:21.109211 8885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:21.110244 8885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "a7a2b116cd824d97a1b46dbb5f90951c"
format_stamp: "Formatted at 2026-08-09 03:23:21 on dist-test-slave-2w3w"
server_key: "9885b0ec3c663a50aff0ded5b45acd66"
server_key_iv: "0b188084d581b37df4ada7dab8ed752b"
server_key_version: "encryptionkey@0"
I20260809 03:23:21.110630 8885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "a7a2b116cd824d97a1b46dbb5f90951c"
format_stamp: "Formatted at 2026-08-09 03:23:21 on dist-test-slave-2w3w"
server_key: "9885b0ec3c663a50aff0ded5b45acd66"
server_key_iv: "0b188084d581b37df4ada7dab8ed752b"
server_key_version: "encryptionkey@0"
I20260809 03:23:21.112073 8885 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:23:21.112841 8902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:21.113019 8885 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:21.113122 8885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "a7a2b116cd824d97a1b46dbb5f90951c"
format_stamp: "Formatted at 2026-08-09 03:23:21 on dist-test-slave-2w3w"
server_key: "9885b0ec3c663a50aff0ded5b45acd66"
server_key_iv: "0b188084d581b37df4ada7dab8ed752b"
server_key_version: "encryptionkey@0"
I20260809 03:23:21.113204 8885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:21.128468 8885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:21.130451 8885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:21.130625 8885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:21.130867 8885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:21.131222 8885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:21.131280 8885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:21.131322 8885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:21.131361 8885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:21.137216 8885 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:33541
I20260809 03:23:21.137272 9025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:33541 every 8 connection(s)
I20260809 03:23:21.137626 8885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
Aug 09 03:23:21 dist-test-slave-2w3w krb5kdc[8771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245801, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:21.145632 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 8885
I20260809 03:23:21.145735 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:23:21.145923 8215 external_mini_cluster.cc:1428] Setting key b2af9ac6164c107a85daf4ff9e70e74c
I20260809 03:23:21.147454 9028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.138401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:44541 (local address 127.8.5.193:57631)
0809 03:23:21.138569 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:21.138612 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:21.139685 (+ 1073us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:21.139917 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:21.139921 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:21.140176 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:21.140374 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:21.140378 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.141036 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.141037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:21.141836 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:21.141838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.142175 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.142176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:21.142272 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.142753 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:21.142761 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:21.144171 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:21.145977 (+ 1806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:21.145985 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:21.145987 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:21.146292 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:21.146511 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:21.146511 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:21.146512 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:21.146643 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:21.146907 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:21.146913 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:21.147079 (+ 166us) client_negotiation.cc:769] Sending connection context
0809 03:23:21.147173 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 03:23:21.147285 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":91,"threads_started":1}
I20260809 03:23:21.147473 8862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.138453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:57631 (local address 127.8.5.254:44541)
0809 03:23:21.138497 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:21.138499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:21.138702 (+ 203us) server_negotiation.cc:407] Connection header received
0809 03:23:21.139777 (+ 1075us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:21.139778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:21.139788 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:21.139851 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:21.140445 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.140958 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.141910 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.142104 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.142156 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.144254 (+ 2098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:21.144255 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:21.144256 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:21.144262 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:21.145885 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:21.146363 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:21.146364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:21.146364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:21.146424 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:21.146690 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:21.146690 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:21.146691 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:21.146837 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:21.146913 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:21.147216 (+ 303us) server_negotiation.cc:299] Negotiation successful
0809 03:23:21.147321 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:23:21.148239 9026 heartbeater.cc:347] Connected to a master server at 127.8.5.254:44541
I20260809 03:23:21.148367 9026 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:21.148543 9026 heartbeater.cc:511] Master 127.8.5.254:44541 requested a full tablet report, sending...
I20260809 03:23:21.149111 8819 ts_manager.cc:194] Registered new tserver with Master: a7a2b116cd824d97a1b46dbb5f90951c (127.8.5.193:33541)
I20260809 03:23:21.149730 8819 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:57631
WARNING: no policy specified for kudu/127.8.5.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
I20260809 03:23:21.173748 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:44541
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:33139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:21.254125 9033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:21.254349 9033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:21.254386 9033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:21.255577 9033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:21.255636 9033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:21.255682 9033 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:23:21.257191 9033 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:33139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:44541
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:21.257464 9033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:21.257695 9033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:21.262405 9041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:21.262562 9033 server_base.cc:1034] running on GCE node
W20260809 03:23:21.262405 9038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:21.262445 9039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:21.262859 9033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:21.263130 9033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:21.264293 9033 hybrid_clock.cc:648] HybridClock initialized: now 1786245801264271 us; error 36 us; skew 500 ppm
Aug 09 03:23:21 dist-test-slave-2w3w krb5kdc[8771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245801, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:21.266811 9033 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:23:21.267266 9033 webserver.cc:460] Webserver started at http://127.8.5.194:44445/ using document root <none> and password file <none>
I20260809 03:23:21.267485 9033 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:21.267553 9033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:21.267700 9033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:21.268714 9033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "6c5b75608c9646319d75ed91a76fb329"
format_stamp: "Formatted at 2026-08-09 03:23:21 on dist-test-slave-2w3w"
server_key: "41082f0db899976c839d5635b73dc780"
server_key_iv: "b445ebd8431972f713e8851de8840e43"
server_key_version: "encryptionkey@0"
I20260809 03:23:21.269074 9033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "6c5b75608c9646319d75ed91a76fb329"
format_stamp: "Formatted at 2026-08-09 03:23:21 on dist-test-slave-2w3w"
server_key: "41082f0db899976c839d5635b73dc780"
server_key_iv: "b445ebd8431972f713e8851de8840e43"
server_key_version: "encryptionkey@0"
I20260809 03:23:21.270367 9033 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:23:21.271166 9048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:21.271366 9033 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:23:21.271462 9033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "6c5b75608c9646319d75ed91a76fb329"
format_stamp: "Formatted at 2026-08-09 03:23:21 on dist-test-slave-2w3w"
server_key: "41082f0db899976c839d5635b73dc780"
server_key_iv: "b445ebd8431972f713e8851de8840e43"
server_key_version: "encryptionkey@0"
I20260809 03:23:21.271548 9033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:21.282581 9033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:21.284343 9033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:21.284502 9033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:21.284723 9033 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:21.285024 9033 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:21.285077 9033 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:21.285117 9033 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:21.285144 9033 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:21.291006 9033 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:41899
I20260809 03:23:21.291041 9172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:41899 every 8 connection(s)
I20260809 03:23:21.291342 9033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
Aug 09 03:23:21 dist-test-slave-2w3w krb5kdc[8771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245801, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:21.298759 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 9033
I20260809 03:23:21.298861 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:23:21.299063 8215 external_mini_cluster.cc:1428] Setting key 6b22052792b3bd46a9b77c1f9d17edaa
I20260809 03:23:21.301282 8862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.291997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:38401 (local address 127.8.5.254:44541)
0809 03:23:21.292064 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:21.292066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:21.292258 (+ 192us) server_negotiation.cc:407] Connection header received
0809 03:23:21.293175 (+ 917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:21.293176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:21.293188 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:21.293232 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:21.293787 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.294264 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.295351 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.295538 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.295594 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.298127 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:21.298128 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:21.298129 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:21.298136 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:21.299768 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:21.300292 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:21.300293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:21.300293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:21.300377 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:21.300664 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:21.300665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:21.300665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:21.300776 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:21.300830 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:21.301152 (+ 322us) server_negotiation.cc:299] Negotiation successful
0809 03:23:21.301218 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 03:23:21.301681 9175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.291945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:44541 (local address 127.8.5.194:38401)
0809 03:23:21.292137 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:21.292172 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:21.293073 (+ 901us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:21.293283 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:21.293286 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:21.293529 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:21.293720 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:21.293724 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.294340 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.294341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:21.295267 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:21.295269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.295610 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.295610 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:21.295704 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.296299 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:21.296309 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:21.298033 (+ 1724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:21.299849 (+ 1816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:21.299857 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:21.299859 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:21.300207 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:21.300450 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:21.300451 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:21.300451 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:21.300597 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:21.300841 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:21.300847 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:21.301018 (+ 171us) client_negotiation.cc:769] Sending connection context
0809 03:23:21.301133 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 03:23:21.301334 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":65,"threads_started":1}
I20260809 03:23:21.302138 9173 heartbeater.cc:347] Connected to a master server at 127.8.5.254:44541
I20260809 03:23:21.302256 9173 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:21.302464 9173 heartbeater.cc:511] Master 127.8.5.254:44541 requested a full tablet report, sending...
I20260809 03:23:21.302870 8819 ts_manager.cc:194] Registered new tserver with Master: 6c5b75608c9646319d75ed91a76fb329 (127.8.5.194:41899)
I20260809 03:23:21.303267 8819 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:38401
WARNING: no policy specified for kudu/127.8.5.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
I20260809 03:23:21.326566 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:44541
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:33139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:21.408488 9178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:21.408726 9178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:21.408767 9178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:21.409931 9178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:21.409996 9178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:21.410043 9178 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:23:21.411589 9178 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:33139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:44541
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9178
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:21.411852 9178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:21.412086 9178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:21.417004 9187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:21.417028 9184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:21.417026 9183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:21.417348 9178 server_base.cc:1034] running on GCE node
I20260809 03:23:21.417618 9178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:21.417820 9178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:21.419040 9178 hybrid_clock.cc:648] HybridClock initialized: now 1786245801419027 us; error 26 us; skew 500 ppm
Aug 09 03:23:21 dist-test-slave-2w3w krb5kdc[8771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245801, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:21.421684 9178 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:23:21.422127 9178 webserver.cc:460] Webserver started at http://127.8.5.195:43187/ using document root <none> and password file <none>
I20260809 03:23:21.422351 9178 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:21.422420 9178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:21.422565 9178 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:21.423674 9178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "1f5cdddb1fa14499b951bbf052518622"
format_stamp: "Formatted at 2026-08-09 03:23:21 on dist-test-slave-2w3w"
server_key: "2db358e789f6e9e62946a882f83aaa1d"
server_key_iv: "1a21b59480b5e614cea888a8fab8d960"
server_key_version: "encryptionkey@0"
I20260809 03:23:21.424036 9178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "1f5cdddb1fa14499b951bbf052518622"
format_stamp: "Formatted at 2026-08-09 03:23:21 on dist-test-slave-2w3w"
server_key: "2db358e789f6e9e62946a882f83aaa1d"
server_key_iv: "1a21b59480b5e614cea888a8fab8d960"
server_key_version: "encryptionkey@0"
I20260809 03:23:21.425397 9178 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:23:21.426160 9194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:21.426456 9178 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:21.426556 9178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "1f5cdddb1fa14499b951bbf052518622"
format_stamp: "Formatted at 2026-08-09 03:23:21 on dist-test-slave-2w3w"
server_key: "2db358e789f6e9e62946a882f83aaa1d"
server_key_iv: "1a21b59480b5e614cea888a8fab8d960"
server_key_version: "encryptionkey@0"
I20260809 03:23:21.426627 9178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:21.450126 9178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:21.452396 9178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:21.452574 9178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:21.452857 9178 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:21.453177 9178 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:21.453233 9178 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:21.453265 9178 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:21.453310 9178 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:21.459553 9178 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:44991
I20260809 03:23:21.459597 9316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:44991 every 8 connection(s)
I20260809 03:23:21.459990 9178 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:23:21.461866 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 9178
I20260809 03:23:21.461975 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:23:21.462167 8215 external_mini_cluster.cc:1428] Setting key 079972cda3dcc3cc036c82a8d2108037
Aug 09 03:23:21 dist-test-slave-2w3w krb5kdc[8771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245801, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:21.469558 8862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.460732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:51037 (local address 127.8.5.254:44541)
0809 03:23:21.460792 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:21.460794 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:21.461013 (+ 219us) server_negotiation.cc:407] Connection header received
0809 03:23:21.462172 (+ 1159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:21.462173 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:21.462185 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:21.462295 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:21.463147 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.463695 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.464803 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.465074 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.465137 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.467329 (+ 2192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:21.467331 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:21.467331 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:21.467337 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:21.468489 (+ 1152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:21.468829 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:21.468830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:21.468830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:21.468888 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:21.469086 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:21.469086 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:21.469086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:21.469178 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:21.469224 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:21.469436 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 03:23:21.469491 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 03:23:21.469736 9319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.460719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:44541 (local address 127.8.5.195:51037)
0809 03:23:21.460888 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:21.460923 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:21.462037 (+ 1114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:21.462399 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:21.462404 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:21.462761 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:21.463054 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:21.463060 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.463798 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.463799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:21.464713 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:21.464715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.465154 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.465154 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:21.465252 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.465766 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:21.465775 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:21.467249 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:21.468556 (+ 1307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:21.468562 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:21.468563 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:21.468768 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:21.468943 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:21.468944 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:21.468944 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:21.469033 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:21.469228 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:21.469232 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:21.469337 (+ 105us) client_negotiation.cc:769] Sending connection context
0809 03:23:21.469412 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 03:23:21.469527 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
I20260809 03:23:21.470185 9317 heartbeater.cc:347] Connected to a master server at 127.8.5.254:44541
I20260809 03:23:21.470270 9317 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:21.470407 9317 heartbeater.cc:511] Master 127.8.5.254:44541 requested a full tablet report, sending...
I20260809 03:23:21.470749 8819 ts_manager.cc:194] Registered new tserver with Master: 1f5cdddb1fa14499b951bbf052518622 (127.8.5.195:44991)
I20260809 03:23:21.471143 8819 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:51037
I20260809 03:23:21.473917 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:23:21.481668 8862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.475776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59236 (local address 127.8.5.254:44541)
0809 03:23:21.475861 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:21.475863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:21.475920 (+ 57us) server_negotiation.cc:407] Connection header received
0809 03:23:21.475993 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:21.475994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:21.476004 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:21.476052 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:21.476675 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.477137 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.477838 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.478031 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.478103 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.479262 (+ 1159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:21.479263 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:21.479263 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:21.479270 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:21.480499 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:21.480804 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:21.480805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:21.480805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:21.480858 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:21.481041 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:21.481042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:21.481042 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:21.481259 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:21.481353 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:21.481483 (+ 130us) server_negotiation.cc:299] Negotiation successful
0809 03:23:21.481545 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 03:23:21.484247 8819 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59236:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:23:21.486073 8819 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:23:21.493240 9330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.489054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:41899 (local address 127.0.0.1:58464)
0809 03:23:21.489377 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:21.489420 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:21.489489 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:21.489743 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:21.489746 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:21.489748 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:21.489820 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:21.489822 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.491202 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.491203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:21.492067 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:21.492069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.492939 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.492940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:21.493031 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.493045 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 03:23:21.493094 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 03:23:21.493143 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":45,"threads_started":1}
I20260809 03:23:21.493353 9329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.489257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:44991 (local address 127.0.0.1:39520)
0809 03:23:21.489625 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:21.489633 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:21.489682 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:21.489999 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:21.490000 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:21.490002 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:21.490039 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:21.490040 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.490998 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.490999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:21.492453 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:21.492455 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.493085 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.493086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:21.493156 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.493161 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 03:23:21.493217 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 03:23:21.493262 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"mutex_wait_us":42,"thread_start_us":86,"threads_started":1}
I20260809 03:23:21.493629 9335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.489352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39520 (local address 127.8.5.195:44991)
0809 03:23:21.489513 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:21.489517 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:21.489761 (+ 244us) server_negotiation.cc:407] Connection header received
0809 03:23:21.489807 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:21.489810 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:21.489825 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:21.489897 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:21.490139 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.490879 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.492540 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.492993 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.493083 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.493143 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:21.493239 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 03:23:21.493276 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":99,"threads_started":1}
I20260809 03:23:21.493640 9331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.489181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58464 (local address 127.8.5.194:41899)
0809 03:23:21.489452 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:21.489455 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:21.489466 (+ 11us) server_negotiation.cc:407] Connection header received
0809 03:23:21.489613 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:21.489617 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:21.489635 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:21.489730 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:21.489909 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.491090 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.492162 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.492840 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.493441 (+ 601us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.493503 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:21.493528 (+ 25us) server_negotiation.cc:299] Negotiation successful
0809 03:23:21.493563 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":74,"threads_started":1}
I20260809 03:23:21.493640 9333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.489201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58812 (local address 127.8.5.193:33541)
0809 03:23:21.489371 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:21.489375 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:21.489599 (+ 224us) server_negotiation.cc:407] Connection header received
0809 03:23:21.489674 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:21.489676 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:21.489690 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:21.489761 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:21.490122 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.491223 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.492492 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.493187 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.493250 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.493302 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:21.493520 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 03:23:21.493563 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":69,"threads_started":1}
I20260809 03:23:21.493870 9334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.489054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:33541 (local address 127.0.0.1:58812)
0809 03:23:21.489510 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:21.489519 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:21.489595 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:21.489849 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:21.489850 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:21.489852 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:21.489929 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:21.489931 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.491317 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.491318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:21.492405 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:21.492407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.493352 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.493353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:21.493420 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.493424 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:23:21.493756 (+ 332us) client_negotiation.cc:240] Negotiation successful
0809 03:23:21.493797 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"mutex_wait_us":1,"thread_start_us":81,"threads_started":1}
I20260809 03:23:21.494501 9100 tablet_service.cc:1467] Processing CreateTablet for tablet abeb50f881fa4babaaf7daaa117d16ce (DEFAULT_TABLE table=test-table [id=67ed896264a74a4d8534fc6a60fc4152]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:21.494555 8953 tablet_service.cc:1467] Processing CreateTablet for tablet abeb50f881fa4babaaf7daaa117d16ce (DEFAULT_TABLE table=test-table [id=67ed896264a74a4d8534fc6a60fc4152]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:21.494903 8953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abeb50f881fa4babaaf7daaa117d16ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:21.494904 9100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abeb50f881fa4babaaf7daaa117d16ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:21.499620 9336 tablet_bootstrap.cc:492] T abeb50f881fa4babaaf7daaa117d16ce P a7a2b116cd824d97a1b46dbb5f90951c: Bootstrap starting.
I20260809 03:23:21.499675 9245 tablet_service.cc:1467] Processing CreateTablet for tablet abeb50f881fa4babaaf7daaa117d16ce (DEFAULT_TABLE table=test-table [id=67ed896264a74a4d8534fc6a60fc4152]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:21.500088 9245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abeb50f881fa4babaaf7daaa117d16ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:21.500562 9336 tablet_bootstrap.cc:654] T abeb50f881fa4babaaf7daaa117d16ce P a7a2b116cd824d97a1b46dbb5f90951c: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:21.501796 9336 log.cc:824] T abeb50f881fa4babaaf7daaa117d16ce P a7a2b116cd824d97a1b46dbb5f90951c: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:21.502156 9337 tablet_bootstrap.cc:492] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329: Bootstrap starting.
I20260809 03:23:21.502751 9336 tablet_bootstrap.cc:492] T abeb50f881fa4babaaf7daaa117d16ce P a7a2b116cd824d97a1b46dbb5f90951c: No bootstrap required, opened a new log
I20260809 03:23:21.502817 9336 ts_tablet_manager.cc:1397] T abeb50f881fa4babaaf7daaa117d16ce P a7a2b116cd824d97a1b46dbb5f90951c: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260809 03:23:21.503394 9337 tablet_bootstrap.cc:654] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:21.504124 9337 log.cc:824] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:21.504570 9340 tablet_bootstrap.cc:492] T abeb50f881fa4babaaf7daaa117d16ce P 1f5cdddb1fa14499b951bbf052518622: Bootstrap starting.
I20260809 03:23:21.505175 9337 tablet_bootstrap.cc:492] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329: No bootstrap required, opened a new log
I20260809 03:23:21.505230 9337 ts_tablet_manager.cc:1397] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 03:23:21.506080 9336 raft_consensus.cc:348] T abeb50f881fa4babaaf7daaa117d16ce P a7a2b116cd824d97a1b46dbb5f90951c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7a2b116cd824d97a1b46dbb5f90951c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33541 } } peers { permanent_uuid: "1f5cdddb1fa14499b951bbf052518622" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44991 } } peers { permanent_uuid: "6c5b75608c9646319d75ed91a76fb329" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41899 } }
I20260809 03:23:21.506278 9336 raft_consensus.cc:374] T abeb50f881fa4babaaf7daaa117d16ce P a7a2b116cd824d97a1b46dbb5f90951c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:21.506356 9336 raft_consensus.cc:729] T abeb50f881fa4babaaf7daaa117d16ce P a7a2b116cd824d97a1b46dbb5f90951c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7a2b116cd824d97a1b46dbb5f90951c, State: Initialized, Role: FOLLOWER
I20260809 03:23:21.506500 9336 consensus_queue.cc:260] T abeb50f881fa4babaaf7daaa117d16ce P a7a2b116cd824d97a1b46dbb5f90951c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7a2b116cd824d97a1b46dbb5f90951c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33541 } } peers { permanent_uuid: "1f5cdddb1fa14499b951bbf052518622" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44991 } } peers { permanent_uuid: "6c5b75608c9646319d75ed91a76fb329" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41899 } }
I20260809 03:23:21.506853 9336 ts_tablet_manager.cc:1428] T abeb50f881fa4babaaf7daaa117d16ce P a7a2b116cd824d97a1b46dbb5f90951c: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260809 03:23:21.507053 9026 heartbeater.cc:503] Master 127.8.5.254:44541 was elected leader, sending a full tablet report...
I20260809 03:23:21.507283 9340 tablet_bootstrap.cc:654] T abeb50f881fa4babaaf7daaa117d16ce P 1f5cdddb1fa14499b951bbf052518622: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:21.508306 9340 log.cc:824] T abeb50f881fa4babaaf7daaa117d16ce P 1f5cdddb1fa14499b951bbf052518622: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:21.508311 9337 raft_consensus.cc:348] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7a2b116cd824d97a1b46dbb5f90951c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33541 } } peers { permanent_uuid: "1f5cdddb1fa14499b951bbf052518622" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44991 } } peers { permanent_uuid: "6c5b75608c9646319d75ed91a76fb329" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41899 } }
I20260809 03:23:21.508527 9337 raft_consensus.cc:374] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:21.508580 9337 raft_consensus.cc:729] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5b75608c9646319d75ed91a76fb329, State: Initialized, Role: FOLLOWER
I20260809 03:23:21.508725 9337 consensus_queue.cc:260] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7a2b116cd824d97a1b46dbb5f90951c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33541 } } peers { permanent_uuid: "1f5cdddb1fa14499b951bbf052518622" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44991 } } peers { permanent_uuid: "6c5b75608c9646319d75ed91a76fb329" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41899 } }
I20260809 03:23:21.509176 9337 ts_tablet_manager.cc:1428] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260809 03:23:21.509253 9340 tablet_bootstrap.cc:492] T abeb50f881fa4babaaf7daaa117d16ce P 1f5cdddb1fa14499b951bbf052518622: No bootstrap required, opened a new log
I20260809 03:23:21.509176 9173 heartbeater.cc:503] Master 127.8.5.254:44541 was elected leader, sending a full tablet report...
I20260809 03:23:21.509321 9340 ts_tablet_manager.cc:1397] T abeb50f881fa4babaaf7daaa117d16ce P 1f5cdddb1fa14499b951bbf052518622: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260809 03:23:21.512061 9340 raft_consensus.cc:348] T abeb50f881fa4babaaf7daaa117d16ce P 1f5cdddb1fa14499b951bbf052518622 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7a2b116cd824d97a1b46dbb5f90951c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33541 } } peers { permanent_uuid: "1f5cdddb1fa14499b951bbf052518622" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44991 } } peers { permanent_uuid: "6c5b75608c9646319d75ed91a76fb329" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41899 } }
I20260809 03:23:21.512254 9340 raft_consensus.cc:374] T abeb50f881fa4babaaf7daaa117d16ce P 1f5cdddb1fa14499b951bbf052518622 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:21.512305 9340 raft_consensus.cc:729] T abeb50f881fa4babaaf7daaa117d16ce P 1f5cdddb1fa14499b951bbf052518622 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f5cdddb1fa14499b951bbf052518622, State: Initialized, Role: FOLLOWER
I20260809 03:23:21.512432 9340 consensus_queue.cc:260] T abeb50f881fa4babaaf7daaa117d16ce P 1f5cdddb1fa14499b951bbf052518622 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7a2b116cd824d97a1b46dbb5f90951c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33541 } } peers { permanent_uuid: "1f5cdddb1fa14499b951bbf052518622" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44991 } } peers { permanent_uuid: "6c5b75608c9646319d75ed91a76fb329" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41899 } }
I20260809 03:23:21.512732 9340 ts_tablet_manager.cc:1428] T abeb50f881fa4babaaf7daaa117d16ce P 1f5cdddb1fa14499b951bbf052518622: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260809 03:23:21.512806 9317 heartbeater.cc:503] Master 127.8.5.254:44541 was elected leader, sending a full tablet report...
W20260809 03:23:21.541986 9174 tablet.cc:2369] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 03:23:21.638491 9027 tablet.cc:2369] T abeb50f881fa4babaaf7daaa117d16ce P a7a2b116cd824d97a1b46dbb5f90951c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:23:21.683631 9343 raft_consensus.cc:482] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:23:21.683784 9343 raft_consensus.cc:504] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7a2b116cd824d97a1b46dbb5f90951c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33541 } } peers { permanent_uuid: "1f5cdddb1fa14499b951bbf052518622" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44991 } } peers { permanent_uuid: "6c5b75608c9646319d75ed91a76fb329" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41899 } }
I20260809 03:23:21.684304 9343 leader_election.cc:288] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7a2b116cd824d97a1b46dbb5f90951c (127.8.5.193:33541), 1f5cdddb1fa14499b951bbf052518622 (127.8.5.195:44991)
I20260809 03:23:21.687706 9333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.684652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:41541 (local address 127.8.5.193:33541)
0809 03:23:21.684731 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:21.684734 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:21.684746 (+ 12us) server_negotiation.cc:407] Connection header received
0809 03:23:21.684957 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:21.684958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:21.684972 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:21.685048 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:21.685329 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.685812 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.686800 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.687249 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.687355 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.687367 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:21.687594 (+ 227us) server_negotiation.cc:299] Negotiation successful
0809 03:23:21.687631 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 03:23:21.687707 9175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.684579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:33541 (local address 127.8.5.194:41541)
0809 03:23:21.684641 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:21.684653 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:21.684743 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:21.685070 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:21.685071 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:21.685073 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:21.685233 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:21.685235 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.685903 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.685904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:21.686696 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:21.686698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.687362 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.687363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:21.687504 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.687507 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:23:21.687585 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 03:23:21.687631 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":1}
I20260809 03:23:21.687816 9335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.684887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:42907 (local address 127.8.5.195:44991)
0809 03:23:21.684935 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:21.684938 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:21.685078 (+ 140us) server_negotiation.cc:407] Connection header received
0809 03:23:21.685156 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:21.685158 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:21.685169 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:21.685214 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:21.685453 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.685916 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.686945 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.687375 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.687463 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.687472 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:21.687682 (+ 210us) server_negotiation.cc:299] Negotiation successful
0809 03:23:21.687727 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 03:23:21.687912 9345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.684723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:44991 (local address 127.8.5.194:42907)
0809 03:23:21.685000 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:21.685010 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:21.685090 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:21.685226 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:21.685227 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:21.685229 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:21.685368 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:21.685370 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.685998 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.685999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:21.686852 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:21.686854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.687464 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.687465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:21.687593 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.687596 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:23:21.687662 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 03:23:21.687706 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":222,"threads_started":1}
I20260809 03:23:21.688428 8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abeb50f881fa4babaaf7daaa117d16ce" candidate_uuid: "6c5b75608c9646319d75ed91a76fb329" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7a2b116cd824d97a1b46dbb5f90951c" is_pre_election: true
I20260809 03:23:21.688469 9267 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abeb50f881fa4babaaf7daaa117d16ce" candidate_uuid: "6c5b75608c9646319d75ed91a76fb329" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f5cdddb1fa14499b951bbf052518622" is_pre_election: true
I20260809 03:23:21.688647 9267 raft_consensus.cc:2454] T abeb50f881fa4babaaf7daaa117d16ce P 1f5cdddb1fa14499b951bbf052518622 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5b75608c9646319d75ed91a76fb329 in term 0.
I20260809 03:23:21.688647 8975 raft_consensus.cc:2454] T abeb50f881fa4babaaf7daaa117d16ce P a7a2b116cd824d97a1b46dbb5f90951c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5b75608c9646319d75ed91a76fb329 in term 0.
I20260809 03:23:21.688905 9051 leader_election.cc:302] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f5cdddb1fa14499b951bbf052518622, 6c5b75608c9646319d75ed91a76fb329; no voters:
I20260809 03:23:21.689072 9343 raft_consensus.cc:2781] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:23:21.689152 9343 raft_consensus.cc:482] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:23:21.689170 9343 raft_consensus.cc:3037] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:21.690261 9343 raft_consensus.cc:504] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7a2b116cd824d97a1b46dbb5f90951c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33541 } } peers { permanent_uuid: "1f5cdddb1fa14499b951bbf052518622" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44991 } } peers { permanent_uuid: "6c5b75608c9646319d75ed91a76fb329" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41899 } }
I20260809 03:23:21.690405 9343 leader_election.cc:288] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329 [CANDIDATE]: Term 1 election: Requested vote from peers a7a2b116cd824d97a1b46dbb5f90951c (127.8.5.193:33541), 1f5cdddb1fa14499b951bbf052518622 (127.8.5.195:44991)
I20260809 03:23:21.690593 9267 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abeb50f881fa4babaaf7daaa117d16ce" candidate_uuid: "6c5b75608c9646319d75ed91a76fb329" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f5cdddb1fa14499b951bbf052518622"
I20260809 03:23:21.690658 9267 raft_consensus.cc:3037] T abeb50f881fa4babaaf7daaa117d16ce P 1f5cdddb1fa14499b951bbf052518622 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:21.690689 8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abeb50f881fa4babaaf7daaa117d16ce" candidate_uuid: "6c5b75608c9646319d75ed91a76fb329" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7a2b116cd824d97a1b46dbb5f90951c"
I20260809 03:23:21.690784 8975 raft_consensus.cc:3037] T abeb50f881fa4babaaf7daaa117d16ce P a7a2b116cd824d97a1b46dbb5f90951c [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:21.691746 9267 raft_consensus.cc:2454] T abeb50f881fa4babaaf7daaa117d16ce P 1f5cdddb1fa14499b951bbf052518622 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5b75608c9646319d75ed91a76fb329 in term 1.
I20260809 03:23:21.691941 9051 leader_election.cc:302] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f5cdddb1fa14499b951bbf052518622, 6c5b75608c9646319d75ed91a76fb329; no voters:
I20260809 03:23:21.692034 8975 raft_consensus.cc:2454] T abeb50f881fa4babaaf7daaa117d16ce P a7a2b116cd824d97a1b46dbb5f90951c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5b75608c9646319d75ed91a76fb329 in term 1.
I20260809 03:23:21.692052 9343 raft_consensus.cc:2781] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:21.692266 9343 raft_consensus.cc:686] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5b75608c9646319d75ed91a76fb329, State: Running, Role: LEADER
I20260809 03:23:21.692392 9343 consensus_queue.cc:237] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7a2b116cd824d97a1b46dbb5f90951c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33541 } } peers { permanent_uuid: "1f5cdddb1fa14499b951bbf052518622" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44991 } } peers { permanent_uuid: "6c5b75608c9646319d75ed91a76fb329" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41899 } }
I20260809 03:23:21.693450 8819 catalog_manager.cc:5495] T abeb50f881fa4babaaf7daaa117d16ce P 6c5b75608c9646319d75ed91a76fb329 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5b75608c9646319d75ed91a76fb329 (127.8.5.194). New cstate: current_term: 1 leader_uuid: "6c5b75608c9646319d75ed91a76fb329" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7a2b116cd824d97a1b46dbb5f90951c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f5cdddb1fa14499b951bbf052518622" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5b75608c9646319d75ed91a76fb329" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41899 } health_report { overall_health: HEALTHY } } }
W20260809 03:23:21.710610 9318 tablet.cc:2369] T abeb50f881fa4babaaf7daaa117d16ce P 1f5cdddb1fa14499b951bbf052518622: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 03:23:21 dist-test-slave-2w3w krb5kdc[8771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245800, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.193@KRBTEST.COM
I20260809 03:23:21.723511 9333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.715790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58822 (local address 127.8.5.193:33541)
0809 03:23:21.715858 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:21.715860 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:21.715997 (+ 137us) server_negotiation.cc:407] Connection header received
0809 03:23:21.716038 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:21.716038 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:21.716048 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:21.716103 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:21.716712 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.717334 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.718120 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.718300 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.718360 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.720786 (+ 2426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:21.720798 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:21.720798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:21.720805 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:21.722430 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:21.722749 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:21.722752 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:21.722752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:21.722830 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:21.723053 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:21.723054 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:21.723054 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:21.723199 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:21.723301 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:21.723378 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 03:23:21.723443 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Aug 09 03:23:21 dist-test-slave-2w3w krb5kdc[8771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245801, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 03:23:21 dist-test-slave-2w3w krb5kdc[8771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245801, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.5.193@KRBTEST.COM
I20260809 03:23:21.747982 9333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.741045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58830 (local address 127.8.5.193:33541)
0809 03:23:21.741126 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:21.741128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:21.741153 (+ 25us) server_negotiation.cc:407] Connection header received
0809 03:23:21.741210 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:21.741211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:21.741221 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:21.741263 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:21.741831 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.742300 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.743061 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.743241 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.743293 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.745508 (+ 2215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:21.745509 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:21.745509 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:21.745516 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:21.746912 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:21.747335 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:21.747336 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:21.747336 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:21.747386 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:21.747550 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:21.747550 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:21.747551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:21.747638 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:21.747712 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:21.747833 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 03:23:21.747890 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
Aug 09 03:23:21 dist-test-slave-2w3w krb5kdc[8771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 03:23:21 dist-test-slave-2w3w krb5kdc[8771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.193@KRBTEST.COM
I20260809 03:23:21.772259 9333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:21.764879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58834 (local address 127.8.5.193:33541)
0809 03:23:21.764931 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:21.764933 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:21.764997 (+ 64us) server_negotiation.cc:407] Connection header received
0809 03:23:21.765049 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:21.765050 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:21.765062 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:21.765159 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:21.765778 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.766268 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.767137 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:21.767347 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:21.767432 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:21.769652 (+ 2220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:21.769653 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:21.769653 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:21.769662 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:21.771114 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:21.771472 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:21.771474 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:21.771474 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:21.771537 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:21.771735 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:21.771736 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:21.771737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:21.771861 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:21.771969 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:21.772070 (+ 101us) server_negotiation.cc:299] Negotiation successful
0809 03:23:21.772148 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
W20260809 03:23:21.772982 8931 tablet_service.cc:2908] Rejecting scan request for tablet abeb50f881fa4babaaf7daaa117d16ce: Uninitialized: clean time has not yet been initialized
I20260809 03:23:21.774036 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 8885
I20260809 03:23:21.780653 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 9033
I20260809 03:23:21.786752 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 9178
I20260809 03:23:21.792636 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 8785
2026-08-09T03:23:21Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2156 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:23:21 dist-test-slave-2w3w krb5kdc[9360](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:23:21 dist-test-slave-2w3w krb5kdc[9360](info): set up 2 sockets
Aug 09 03:23:21 dist-test-slave-2w3w krb5kdc[9360](info): commencing operation
krb5kdc: starting...
W20260809 03:23:22.860261 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:23:22 dist-test-slave-2w3w krb5kdc[9360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245802, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:23:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:23:22.978849 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:33681
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:33681
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:23.063830 9373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:23.064016 9373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:23.064038 9373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:23.065088 9373 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:23.065122 9373 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 03:23:23.065135 9373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:23.065148 9373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:23.065160 9373 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:23.065172 9373 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:23:23.066542 9373 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:33681
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:33681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:23.066721 9373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:23.066933 9373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:23.071664 9379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:23.071687 9380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:23.071707 9382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:23.071759 9373 server_base.cc:1034] running on GCE node
I20260809 03:23:23.072075 9373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:23.072306 9373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:23.073473 9373 hybrid_clock.cc:648] HybridClock initialized: now 1786245803073463 us; error 28 us; skew 500 ppm
Aug 09 03:23:23 dist-test-slave-2w3w krb5kdc[9360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245803, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:23.079222 9373 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:23:23.079702 9373 webserver.cc:460] Webserver started at http://127.8.5.254:35031/ using document root <none> and password file <none>
I20260809 03:23:23.079952 9373 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:23.080019 9373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:23.080190 9373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:23.081262 9373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "2893644eab334b4ab0da66a5e9cb3852"
format_stamp: "Formatted at 2026-08-09 03:23:23 on dist-test-slave-2w3w"
server_key: "e63a38e402ead22790161381225ca699"
server_key_iv: "e2b3c18b6de9ec86b41824e583403455"
server_key_version: "encryptionkey@0"
I20260809 03:23:23.081557 9373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "2893644eab334b4ab0da66a5e9cb3852"
format_stamp: "Formatted at 2026-08-09 03:23:23 on dist-test-slave-2w3w"
server_key: "e63a38e402ead22790161381225ca699"
server_key_iv: "e2b3c18b6de9ec86b41824e583403455"
server_key_version: "encryptionkey@0"
I20260809 03:23:23.082795 9373 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:23:23.083647 9389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:23.083830 9373 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:23.083932 9373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "2893644eab334b4ab0da66a5e9cb3852"
format_stamp: "Formatted at 2026-08-09 03:23:23 on dist-test-slave-2w3w"
server_key: "e63a38e402ead22790161381225ca699"
server_key_iv: "e2b3c18b6de9ec86b41824e583403455"
server_key_version: "encryptionkey@0"
I20260809 03:23:23.084015 9373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:23.100966 9373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:23.102840 9373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:23.103042 9373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:23.108183 9373 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:33681
I20260809 03:23:23.108237 9457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:33681 every 8 connection(s)
I20260809 03:23:23.108552 9373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:23.109169 9458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:23.111452 9458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852: Bootstrap starting.
I20260809 03:23:23.112056 9458 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:23.112368 9458 log.cc:824] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:23.113030 9458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852: No bootstrap required, opened a new log
I20260809 03:23:23.113760 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 9373
I20260809 03:23:23.113875 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:23:23.114045 8215 external_mini_cluster.cc:1428] Setting key cc1012ce28c0f80dba3c39ab08768cb3
I20260809 03:23:23.115221 9458 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2893644eab334b4ab0da66a5e9cb3852" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33681 } }
I20260809 03:23:23.115391 9458 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:23.115444 9458 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2893644eab334b4ab0da66a5e9cb3852, State: Initialized, Role: FOLLOWER
I20260809 03:23:23.115617 9458 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2893644eab334b4ab0da66a5e9cb3852" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33681 } }
I20260809 03:23:23.115712 9458 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:23.115758 9458 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:23.115806 9458 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:23.116389 9458 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2893644eab334b4ab0da66a5e9cb3852" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33681 } }
I20260809 03:23:23.116505 9458 leader_election.cc:302] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2893644eab334b4ab0da66a5e9cb3852; no voters:
I20260809 03:23:23.116663 9458 leader_election.cc:288] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:23:23.116741 9463 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:23.116911 9463 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852 [term 1 LEADER]: Becoming Leader. State: Replica: 2893644eab334b4ab0da66a5e9cb3852, State: Running, Role: LEADER
I20260809 03:23:23.116918 9458 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:23.117017 9463 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2893644eab334b4ab0da66a5e9cb3852" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33681 } }
I20260809 03:23:23.117379 9463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2893644eab334b4ab0da66a5e9cb3852. Latest consensus state: current_term: 1 leader_uuid: "2893644eab334b4ab0da66a5e9cb3852" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2893644eab334b4ab0da66a5e9cb3852" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33681 } } }
I20260809 03:23:23.117386 9464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2893644eab334b4ab0da66a5e9cb3852" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2893644eab334b4ab0da66a5e9cb3852" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33681 } } }
I20260809 03:23:23.117543 9463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:23.117552 9464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:23.117815 9473 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:23.118533 9473 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:23.120090 9473 catalog_manager.cc:1347] Generated new cluster ID: aabe5a5f8f5342409b519c09aa78c0a1
I20260809 03:23:23.120142 9473 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 03:23:23 dist-test-slave-2w3w krb5kdc[9360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245802, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:23.126259 9462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.114573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52718 (local address 127.8.5.254:33681)
0809 03:23:23.114772 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:23.114786 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:23.114812 (+ 26us) server_negotiation.cc:407] Connection header received
0809 03:23:23.115310 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:23.115324 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:23.115373 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:23.115541 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:23.116362 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.117882 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.119072 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.119687 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.120117 (+ 430us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.122653 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:23.122657 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:23.122657 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:23.122668 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:23.124599 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:23.125028 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:23.125031 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:23.125031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:23.125146 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:23.125371 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:23.125371 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:23.125372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:23.125660 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:23.125799 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:23.125937 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 03:23:23.126067 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":75,"threads_started":1}
I20260809 03:23:23.136052 9473 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:23:23.136754 9473 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:23.149999 9473 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852: Generated new TSK 0
I20260809 03:23:23.150211 9473 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
I20260809 03:23:23.182723 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33681
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:23.269663 9486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:23.269861 9486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:23.269886 9486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:23.271114 9486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:23.271153 9486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:23.271173 9486 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 03:23:23.271237 9486 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:23:23.272650 9486 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.5.254:33681
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9486
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:23.272889 9486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:23.273116 9486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 03:23:23.278143 9486 server_base.cc:1034] running on GCE node
W20260809 03:23:23.278090 9491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:23.278116 9494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:23.278100 9492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:23.278543 9486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:23.278834 9486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:23.279994 9486 hybrid_clock.cc:648] HybridClock initialized: now 1786245803279969 us; error 39 us; skew 500 ppm
Aug 09 03:23:23 dist-test-slave-2w3w krb5kdc[9360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245803, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:23.282488 9486 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:23:23.282929 9486 webserver.cc:460] Webserver started at http://127.8.5.193:40085/ using document root <none> and password file <none>
I20260809 03:23:23.283177 9486 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:23.283246 9486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:23.283399 9486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:23.284482 9486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "335ad26d715c4362a2151f8118ceae67"
format_stamp: "Formatted at 2026-08-09 03:23:23 on dist-test-slave-2w3w"
server_key: "04a30abe4fdccbc513ad1eef01735818"
server_key_iv: "4e162ba5ea854e5c2b5e2b399628a3db"
server_key_version: "encryptionkey@0"
I20260809 03:23:23.284857 9486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "335ad26d715c4362a2151f8118ceae67"
format_stamp: "Formatted at 2026-08-09 03:23:23 on dist-test-slave-2w3w"
server_key: "04a30abe4fdccbc513ad1eef01735818"
server_key_iv: "4e162ba5ea854e5c2b5e2b399628a3db"
server_key_version: "encryptionkey@0"
I20260809 03:23:23.286159 9486 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:23:23.286856 9502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:23.287081 9486 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:23:23.287177 9486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "335ad26d715c4362a2151f8118ceae67"
format_stamp: "Formatted at 2026-08-09 03:23:23 on dist-test-slave-2w3w"
server_key: "04a30abe4fdccbc513ad1eef01735818"
server_key_iv: "4e162ba5ea854e5c2b5e2b399628a3db"
server_key_version: "encryptionkey@0"
I20260809 03:23:23.287269 9486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:23.306813 9486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:23.308983 9486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:23.309154 9486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:23.309695 9486 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:23.309753 9486 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:23.309787 9486 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:23.309827 9486 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 03:23:23 dist-test-slave-2w3w krb5kdc[9360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245803, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:23.317670 9486 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:45185
I20260809 03:23:23.317768 9623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:45185 every 8 connection(s)
I20260809 03:23:23.318156 9486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:23:23.318624 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 9486
I20260809 03:23:23.318719 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:23:23.318915 8215 external_mini_cluster.cc:1428] Setting key 2e89209465f6e1ef398734c52b597232
I20260809 03:23:23.320315 9462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.310363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:35601 (local address 127.8.5.254:33681)
0809 03:23:23.310439 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:23.310441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:23.310671 (+ 230us) server_negotiation.cc:407] Connection header received
0809 03:23:23.311478 (+ 807us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:23.311479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:23.311498 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:23.311553 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:23.312244 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.312761 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.313931 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.314151 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.314239 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.317058 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:23.317059 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:23.317060 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:23.317067 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:23.318839 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:23.319330 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:23.319331 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:23.319331 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:23.319384 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:23.319651 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:23.319652 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:23.319653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:23.319786 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:23.319844 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:23.320180 (+ 336us) server_negotiation.cc:299] Negotiation successful
0809 03:23:23.320251 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 03:23:23.320596 9511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.310310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33681 (local address 127.8.5.193:35601)
0809 03:23:23.310520 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:23.310572 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:23.311331 (+ 759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:23.311646 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:23.311650 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:23.311933 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:23.312140 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.312145 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.312875 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.312876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.313836 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.313839 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.314253 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.314254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.314377 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.314916 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:23.314924 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:23.316980 (+ 2056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:23.318919 (+ 1939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:23.318925 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:23.318927 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:23.319227 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:23.319449 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:23.319449 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:23.319450 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:23.319592 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:23.319860 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:23.319868 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:23.320037 (+ 169us) client_negotiation.cc:769] Sending connection context
0809 03:23:23.320143 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 03:23:23.320323 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":107,"threads_started":1}
I20260809 03:23:23.321070 9624 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33681
I20260809 03:23:23.321229 9624 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:23.321458 9624 heartbeater.cc:511] Master 127.8.5.254:33681 requested a full tablet report, sending...
I20260809 03:23:23.322055 9407 ts_manager.cc:194] Registered new tserver with Master: 335ad26d715c4362a2151f8118ceae67 (127.8.5.193:45185)
I20260809 03:23:23.322955 9407 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:35601
I20260809 03:23:23.328086 9462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.322310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:52675 (local address 127.8.5.254:33681)
0809 03:23:23.322360 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:23.322361 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:23.322369 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:23:23.322394 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:23.322395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:23.322406 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:23.322480 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:23.322814 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.323612 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.324360 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.324676 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.324750 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.325636 (+ 886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:23.325641 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:23.325642 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:23.325648 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:23.326940 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:23.327309 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:23.327310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:23.327311 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:23.327364 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:23.327568 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:23.327569 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:23.327569 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:23.327678 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:23.327752 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:23.327920 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 03:23:23.327999 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 03:23:23.328102 9632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.322148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33681 (local address 127.8.5.193:52675)
0809 03:23:23.322275 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:23.322288 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:23.322347 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:23.322486 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:23.322487 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:23.322673 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:23.322742 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.322744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.323715 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.323716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.324276 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.324279 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.324760 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.324760 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.324817 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.325234 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:23.325238 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:23.325543 (+ 305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:23.327059 (+ 1516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:23.327060 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:23.327061 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:23.327234 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:23.327436 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:23.327437 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:23.327438 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:23.327494 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:23.327744 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:23.327744 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:23.327799 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 03:23:23.327882 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 03:23:23.327992 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":72,"threads_started":1}
WARNING: no policy specified for kudu/127.8.5.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
I20260809 03:23:23.345649 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33681
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:23.427855 9634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:23.428067 9634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:23.428092 9634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:23.429267 9634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:23.429322 9634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:23.429371 9634 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 03:23:23.429410 9634 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:23:23.430846 9634 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.5.254:33681
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:23.431133 9634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:23.431382 9634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:23.436278 9639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:23.436408 9634 server_base.cc:1034] running on GCE node
W20260809 03:23:23.436254 9642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:23.436515 9640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:23.436717 9634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:23.436964 9634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:23.438123 9634 hybrid_clock.cc:648] HybridClock initialized: now 1786245803438099 us; error 39 us; skew 500 ppm
Aug 09 03:23:23 dist-test-slave-2w3w krb5kdc[9360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245803, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:23.440678 9634 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:23:23.441051 9634 webserver.cc:460] Webserver started at http://127.8.5.194:46703/ using document root <none> and password file <none>
I20260809 03:23:23.441228 9634 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:23.441267 9634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:23.441371 9634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:23.442385 9634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "2f3b80f633eb41098342ad15e5911f3e"
format_stamp: "Formatted at 2026-08-09 03:23:23 on dist-test-slave-2w3w"
server_key: "de3fda1b21272c2198dfdf8c2490c50e"
server_key_iv: "47e52f2c018966b5b9d16957cdc79034"
server_key_version: "encryptionkey@0"
I20260809 03:23:23.442685 9634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "2f3b80f633eb41098342ad15e5911f3e"
format_stamp: "Formatted at 2026-08-09 03:23:23 on dist-test-slave-2w3w"
server_key: "de3fda1b21272c2198dfdf8c2490c50e"
server_key_iv: "47e52f2c018966b5b9d16957cdc79034"
server_key_version: "encryptionkey@0"
I20260809 03:23:23.444038 9634 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:23:23.444743 9650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:23.444950 9634 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:23:23.445035 9634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "2f3b80f633eb41098342ad15e5911f3e"
format_stamp: "Formatted at 2026-08-09 03:23:23 on dist-test-slave-2w3w"
server_key: "de3fda1b21272c2198dfdf8c2490c50e"
server_key_iv: "47e52f2c018966b5b9d16957cdc79034"
server_key_version: "encryptionkey@0"
I20260809 03:23:23.445089 9634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:23.458072 9634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:23.459976 9634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:23.460086 9634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:23.460599 9634 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:23.460642 9634 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:23.460665 9634 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:23.460678 9634 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:23.467474 9634 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:46147
I20260809 03:23:23.467532 9774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:46147 every 8 connection(s)
Aug 09 03:23:23 dist-test-slave-2w3w krb5kdc[9360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245803, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:23.467949 9634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:23:23.470606 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 9634
I20260809 03:23:23.470697 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:23:23.470693 9462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.461121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:34665 (local address 127.8.5.254:33681)
0809 03:23:23.461203 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:23.461207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:23.461356 (+ 149us) server_negotiation.cc:407] Connection header received
0809 03:23:23.461832 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:23.461834 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:23.461848 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:23.461929 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:23.462776 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.463629 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.465274 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.465613 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.465697 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.468427 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:23.468428 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:23.468429 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:23.468435 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:23.469518 (+ 1083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:23.469880 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:23.469881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:23.469881 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:23.469932 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:23.470100 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:23.470101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:23.470101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:23.470197 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:23.470244 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:23.470491 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 03:23:23.470579 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 03:23:23.470750 9659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.461043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33681 (local address 127.8.5.194:34665)
0809 03:23:23.461220 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:23.461259 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:23.461733 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:23.462035 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:23.462039 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:23.462396 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:23.462683 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.462690 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.463723 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.463725 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.465160 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.465163 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.465706 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.465707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.465804 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.466337 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:23.466357 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:23.468245 (+ 1888us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:23.469586 (+ 1341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:23.469592 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:23.469594 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:23.469809 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:23.469974 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:23.469974 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:23.469974 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:23.470053 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:23.470251 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:23.470256 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:23.470364 (+ 108us) client_negotiation.cc:769] Sending connection context
0809 03:23:23.470443 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 03:23:23.470556 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":95,"threads_started":1}
I20260809 03:23:23.470871 8215 external_mini_cluster.cc:1428] Setting key f415f0310b0d060bb2f5f5a60ebaef24
I20260809 03:23:23.471261 9775 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33681
I20260809 03:23:23.471350 9775 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:23.471524 9775 heartbeater.cc:511] Master 127.8.5.254:33681 requested a full tablet report, sending...
I20260809 03:23:23.471892 9408 ts_manager.cc:194] Registered new tserver with Master: 2f3b80f633eb41098342ad15e5911f3e (127.8.5.194:46147)
I20260809 03:23:23.472322 9408 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:34665
I20260809 03:23:23.480367 9462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.472318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:55085 (local address 127.8.5.254:33681)
0809 03:23:23.472383 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:23.472385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:23.472444 (+ 59us) server_negotiation.cc:407] Connection header received
0809 03:23:23.474156 (+ 1712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:23.474157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:23.474171 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:23.474243 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:23.474604 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.475388 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.476473 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.476645 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.476689 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.477735 (+ 1046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:23.477736 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:23.477736 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:23.477742 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:23.479168 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:23.479569 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:23.479570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:23.479570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:23.479621 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:23.479824 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:23.479825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:23.479825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:23.479956 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:23.480009 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:23.480221 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 03:23:23.480294 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 03:23:23.480407 9783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.472257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33681 (local address 127.8.5.194:55085)
0809 03:23:23.472386 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:23.472395 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:23.472468 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:23.474248 (+ 1780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:23.474249 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:23.474437 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:23.474520 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.474523 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.475484 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.475485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.476384 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.476387 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.476715 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.476716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.476800 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.477186 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:23.477191 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:23.477642 (+ 451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:23.479250 (+ 1608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:23.479251 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:23.479251 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:23.479496 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:23.479689 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:23.479689 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:23.479690 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:23.479761 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:23.480027 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:23.480028 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:23.480078 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 03:23:23.480166 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 03:23:23.480270 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":66,"threads_started":1}
WARNING: no policy specified for kudu/127.8.5.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
I20260809 03:23:23.499652 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33681
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:23.580212 9786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:23.580422 9786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:23.580446 9786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:23.581717 9786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:23.581763 9786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:23.581784 9786 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 03:23:23.581800 9786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:23:23.583329 9786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.5.254:33681
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:23.583581 9786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:23.583822 9786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:23.589043 9797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:23.589054 9794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:23.589083 9792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:23.589119 9786 server_base.cc:1034] running on GCE node
I20260809 03:23:23.589521 9786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:23.589835 9786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:23.591022 9786 hybrid_clock.cc:648] HybridClock initialized: now 1786245803591001 us; error 30 us; skew 500 ppm
Aug 09 03:23:23 dist-test-slave-2w3w krb5kdc[9360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245803, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:23.593530 9786 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:23:23.594086 9786 webserver.cc:460] Webserver started at http://127.8.5.195:44097/ using document root <none> and password file <none>
I20260809 03:23:23.594348 9786 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:23.594420 9786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:23.594560 9786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:23.595723 9786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "8cd5d11f5f4841539173cff8c0df8a34"
format_stamp: "Formatted at 2026-08-09 03:23:23 on dist-test-slave-2w3w"
server_key: "8afb5d6a70e9c7b07ee77f50b60d53d4"
server_key_iv: "59364d1c4c1a2688944aa119aeaf4219"
server_key_version: "encryptionkey@0"
I20260809 03:23:23.596113 9786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "8cd5d11f5f4841539173cff8c0df8a34"
format_stamp: "Formatted at 2026-08-09 03:23:23 on dist-test-slave-2w3w"
server_key: "8afb5d6a70e9c7b07ee77f50b60d53d4"
server_key_iv: "59364d1c4c1a2688944aa119aeaf4219"
server_key_version: "encryptionkey@0"
I20260809 03:23:23.597447 9786 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:23:23.598227 9805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:23.598415 9786 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:23.598521 9786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "8cd5d11f5f4841539173cff8c0df8a34"
format_stamp: "Formatted at 2026-08-09 03:23:23 on dist-test-slave-2w3w"
server_key: "8afb5d6a70e9c7b07ee77f50b60d53d4"
server_key_iv: "59364d1c4c1a2688944aa119aeaf4219"
server_key_version: "encryptionkey@0"
I20260809 03:23:23.598594 9786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:23.611294 9786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:23.613058 9786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:23.613222 9786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:23.613790 9786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:23.613862 9786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:23.613904 9786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:23.613936 9786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 03:23:23 dist-test-slave-2w3w krb5kdc[9360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245803, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:23.621304 9786 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:46069
I20260809 03:23:23.621407 9932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:46069 every 8 connection(s)
I20260809 03:23:23.621682 9786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:23:23.623956 9462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.614210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:58989 (local address 127.8.5.254:33681)
0809 03:23:23.614260 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:23.614262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:23.614526 (+ 264us) server_negotiation.cc:407] Connection header received
0809 03:23:23.615173 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:23.615175 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:23.615189 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:23.615266 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:23.615907 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.616735 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.618320 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.618629 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.618717 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.620983 (+ 2266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:23.620985 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:23.620985 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:23.620995 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:23.622658 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:23.623124 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:23.623125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:23.623125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:23.623177 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:23.623374 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:23.623374 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:23.623375 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:23.623469 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:23.623516 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:23.623829 (+ 313us) server_negotiation.cc:299] Negotiation successful
0809 03:23:23.623893 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:23:23.624125 9814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.614213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33681 (local address 127.8.5.195:58989)
0809 03:23:23.614385 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:23.614437 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:23.615060 (+ 623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:23.615347 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:23.615351 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:23.615639 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:23.615817 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.615821 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.616852 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.616853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.618188 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.618192 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.618738 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.618739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.618885 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.619453 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:23.619462 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:23.620888 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:23.622756 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:23.622762 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:23.622764 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:23.623053 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:23.623221 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:23.623222 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:23.623222 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:23.623319 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:23.623563 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:23.623569 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:23.623690 (+ 121us) client_negotiation.cc:769] Sending connection context
0809 03:23:23.623778 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 03:23:23.623927 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":97,"threads_started":1}
I20260809 03:23:23.624605 9933 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33681
I20260809 03:23:23.624737 9933 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:23.624748 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 9786
I20260809 03:23:23.624861 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:23:23.625012 9933 heartbeater.cc:511] Master 127.8.5.254:33681 requested a full tablet report, sending...
I20260809 03:23:23.625051 8215 external_mini_cluster.cc:1428] Setting key a0d177405ac3ed9a54cd557a9c2779fe
I20260809 03:23:23.625483 9407 ts_manager.cc:194] Registered new tserver with Master: 8cd5d11f5f4841539173cff8c0df8a34 (127.8.5.195:46069)
I20260809 03:23:23.626024 9407 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:58989
I20260809 03:23:23.626596 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:23:23.631809 9462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.625763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:46951 (local address 127.8.5.254:33681)
0809 03:23:23.625800 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:23.625802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:23.625984 (+ 182us) server_negotiation.cc:407] Connection header received
0809 03:23:23.626036 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:23.626037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:23.626048 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:23.626097 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:23.626547 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.627282 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.627948 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.628242 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.628314 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.629331 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:23.629332 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:23.629332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:23.629338 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:23.630595 (+ 1257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:23.631033 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:23.631034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:23.631035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:23.631091 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:23.631304 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:23.631304 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:23.631304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:23.631462 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:23.631523 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:23.631694 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 03:23:23.631750 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 03:23:23.631902 9939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.625721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33681 (local address 127.8.5.195:46951)
0809 03:23:23.625908 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:23.625920 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:23.625981 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:23.626099 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:23.626100 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:23.626365 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:23.626447 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.626449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.627375 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.627375 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.627865 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.627867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.628326 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.628326 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.628384 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.628825 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:23.628832 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:23.629230 (+ 398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:23.630675 (+ 1445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:23.630676 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:23.630677 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:23.630910 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:23.631163 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:23.631164 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:23.631164 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:23.631238 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:23.631540 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:23.631541 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:23.631593 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 03:23:23.631680 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 03:23:23.631785 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":73,"threads_started":1}
Aug 09 03:23:23 dist-test-slave-2w3w krb5kdc[9360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245803, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 03:23:23 dist-test-slave-2w3w krb5kdc[9360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245803, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:23.650826 9462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.643825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52726 (local address 127.8.5.254:33681)
0809 03:23:23.643885 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:23.643888 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:23.643913 (+ 25us) server_negotiation.cc:407] Connection header received
0809 03:23:23.643944 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:23.643944 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:23.643953 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:23.644015 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:23.644563 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.645040 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.645807 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.645992 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.646081 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.648419 (+ 2338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:23.648421 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:23.648421 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:23.648428 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:23.649656 (+ 1228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:23.650077 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:23.650078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:23.650078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:23.650151 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:23.650338 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:23.650339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:23.650339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:23.650437 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:23.650516 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:23.650658 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 03:23:23.650720 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 03:23:23.652248 9408 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52726:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:23:23.653725 9408 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:23:23.659970 9952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.656013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:46147 (local address 127.0.0.1:37618)
0809 03:23:23.656425 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:23.656434 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:23.656529 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:23.656731 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:23.656734 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:23.656736 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:23.656809 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.656811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.657663 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.657664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.658679 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.658681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.659652 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.659652 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.659733 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.659752 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 03:23:23.659833 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 03:23:23.659886 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"mutex_wait_us":1,"thread_start_us":91,"threads_started":1}
I20260809 03:23:23.659982 9955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.656193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37618 (local address 127.8.5.194:46147)
0809 03:23:23.656381 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:23.656386 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:23.656566 (+ 180us) server_negotiation.cc:407] Connection header received
0809 03:23:23.656618 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:23.656620 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:23.656633 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:23.656718 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:23.656891 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.657574 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.658779 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.659560 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.659640 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.659703 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:23.659851 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 03:23:23.659889 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":73,"threads_started":1}
I20260809 03:23:23.660669 9953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.656013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:46069 (local address 127.0.0.1:33396)
0809 03:23:23.656160 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:23.656204 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:23.656270 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:23.656820 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:23.656821 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:23.656823 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:23.656884 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.656886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.658228 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.658229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.659373 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.659376 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.660422 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.660423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.660495 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.660499 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:23:23.660561 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 03:23:23.660600 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":59,"threads_started":1}
I20260809 03:23:23.660679 9956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.656247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33396 (local address 127.8.5.195:46069)
0809 03:23:23.656650 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:23.656654 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:23.656663 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:23:23.656700 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:23.656703 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:23.656718 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:23.656965 (+ 247us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:23.657028 (+ 63us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.658136 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.659458 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.660290 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.660397 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.660454 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:23.660577 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 03:23:23.660608 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":98,"threads_started":1}
I20260809 03:23:23.660737 9702 tablet_service.cc:1467] Processing CreateTablet for tablet 4c59746be37840f599c778d668f26555 (DEFAULT_TABLE table=test-table [id=ad4fb3d3ca54437e973e51d2f55e5d43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:23.661134 9702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c59746be37840f599c778d668f26555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:23.661315 9859 tablet_service.cc:1467] Processing CreateTablet for tablet 4c59746be37840f599c778d668f26555 (DEFAULT_TABLE table=test-table [id=ad4fb3d3ca54437e973e51d2f55e5d43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:23.661648 9859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c59746be37840f599c778d668f26555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:23.664932 9959 tablet_bootstrap.cc:492] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e: Bootstrap starting.
I20260809 03:23:23.665145 9954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.656027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:45185 (local address 127.0.0.1:53368)
0809 03:23:23.656453 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:23.656462 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:23.656514 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:23.656974 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:23.656975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:23.656976 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:23.657006 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.657007 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.658303 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.658304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.659260 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.659263 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.664922 (+ 5659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.664923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.664986 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.664989 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:23:23.665048 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 03:23:23.665094 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":88,"threads_started":1}
I20260809 03:23:23.665154 9958 tablet_bootstrap.cc:492] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34: Bootstrap starting.
I20260809 03:23:23.665433 9957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.656273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53368 (local address 127.8.5.193:45185)
0809 03:23:23.656431 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:23.656435 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:23.656502 (+ 67us) server_negotiation.cc:407] Connection header received
0809 03:23:23.656853 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:23.656855 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:23.656872 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:23.657079 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:23.657136 (+ 57us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.658176 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.659345 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.660231 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.660313 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.660376 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:23.665275 (+ 4899us) server_negotiation.cc:299] Negotiation successful
0809 03:23:23.665329 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":91,"threads_started":1}
I20260809 03:23:23.666074 9958 tablet_bootstrap.cc:654] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:23.666028 9553 tablet_service.cc:1467] Processing CreateTablet for tablet 4c59746be37840f599c778d668f26555 (DEFAULT_TABLE table=test-table [id=ad4fb3d3ca54437e973e51d2f55e5d43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:23.666322 9553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c59746be37840f599c778d668f26555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:23.666438 9958 log.cc:824] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:23.667304 9958 tablet_bootstrap.cc:492] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34: No bootstrap required, opened a new log
I20260809 03:23:23.667326 9959 tablet_bootstrap.cc:654] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:23.667389 9958 ts_tablet_manager.cc:1397] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:23:23.667673 9959 log.cc:824] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:23.668363 9959 tablet_bootstrap.cc:492] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e: No bootstrap required, opened a new log
I20260809 03:23:23.668444 9959 ts_tablet_manager.cc:1397] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260809 03:23:23.669468 9958 raft_consensus.cc:348] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } }
I20260809 03:23:23.669638 9958 raft_consensus.cc:374] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:23.669672 9958 raft_consensus.cc:729] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd5d11f5f4841539173cff8c0df8a34, State: Initialized, Role: FOLLOWER
I20260809 03:23:23.669821 9958 consensus_queue.cc:260] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } }
I20260809 03:23:23.669898 9959 raft_consensus.cc:348] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } }
I20260809 03:23:23.670051 9959 raft_consensus.cc:374] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:23.670095 9959 raft_consensus.cc:729] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f3b80f633eb41098342ad15e5911f3e, State: Initialized, Role: FOLLOWER
I20260809 03:23:23.670109 9958 ts_tablet_manager.cc:1428] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 03:23:23.670122 9933 heartbeater.cc:503] Master 127.8.5.254:33681 was elected leader, sending a full tablet report...
I20260809 03:23:23.670199 9959 consensus_queue.cc:260] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } }
I20260809 03:23:23.670471 9959 ts_tablet_manager.cc:1428] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 03:23:23.670594 9775 heartbeater.cc:503] Master 127.8.5.254:33681 was elected leader, sending a full tablet report...
I20260809 03:23:23.670691 9962 tablet_bootstrap.cc:492] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67: Bootstrap starting.
I20260809 03:23:23.671753 9962 tablet_bootstrap.cc:654] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:23.672482 9962 log.cc:824] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:23.673158 9962 tablet_bootstrap.cc:492] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67: No bootstrap required, opened a new log
I20260809 03:23:23.673242 9962 ts_tablet_manager.cc:1397] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 03:23:23.675995 9962 raft_consensus.cc:348] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } }
I20260809 03:23:23.676151 9962 raft_consensus.cc:374] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:23.676198 9962 raft_consensus.cc:729] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 335ad26d715c4362a2151f8118ceae67, State: Initialized, Role: FOLLOWER
I20260809 03:23:23.676347 9962 consensus_queue.cc:260] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } }
I20260809 03:23:23.676708 9962 ts_tablet_manager.cc:1428] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260809 03:23:23.676744 9624 heartbeater.cc:503] Master 127.8.5.254:33681 was elected leader, sending a full tablet report...
W20260809 03:23:23.718623 9776 tablet.cc:2369] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 03:23:23.819464 9626 tablet.cc:2369] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 03:23:23.872339 9934 tablet.cc:2369] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:23:23.884039 9966 raft_consensus.cc:482] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:23:23.884160 9966 raft_consensus.cc:504] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } }
I20260809 03:23:23.884632 9966 leader_election.cc:288] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f3b80f633eb41098342ad15e5911f3e (127.8.5.194:46147), 8cd5d11f5f4841539173cff8c0df8a34 (127.8.5.195:46069)
I20260809 03:23:23.888682 9956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.884901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:48271 (local address 127.8.5.195:46069)
0809 03:23:23.884956 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:23.884959 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:23.885037 (+ 78us) server_negotiation.cc:407] Connection header received
0809 03:23:23.885103 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:23.885103 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:23.885116 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:23.885179 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:23.885389 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.886139 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.887713 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.888310 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.888369 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.888376 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:23.888563 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 03:23:23.888607 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 03:23:23.888682 9955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.884989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:58623 (local address 127.8.5.194:46147)
0809 03:23:23.885032 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:23.885033 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:23.885043 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:23:23.885102 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:23.885103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:23.885116 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:23.885179 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:23.885389 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.886138 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.887713 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.888260 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.888334 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.888348 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:23.888577 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 03:23:23.888615 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:23:23.888698 9968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.884807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:46069 (local address 127.8.5.193:48271)
0809 03:23:23.884980 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:23.884989 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:23.885043 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:23.885198 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:23.885199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:23.885202 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:23.885298 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.885300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.886223 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.886224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.887610 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.887614 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.888374 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.888375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.888441 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.888445 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:23:23.888533 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 03:23:23.888588 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":22,"thread_start_us":108,"threads_started":1}
I20260809 03:23:23.888806 9967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.884784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:46147 (local address 127.8.5.193:58623)
0809 03:23:23.884967 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:23.884979 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:23.885043 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:23.885198 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:23.885199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:23.885203 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:23.885309 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.885311 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.886226 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.886226 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.887610 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:23.887614 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.888356 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.888358 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:23.888503 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.888508 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 03:23:23.888561 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 03:23:23.888590 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":114,"thread_start_us":69,"threads_started":1}
I20260809 03:23:23.889180 9879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c59746be37840f599c778d668f26555" candidate_uuid: "335ad26d715c4362a2151f8118ceae67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd5d11f5f4841539173cff8c0df8a34" is_pre_election: true
I20260809 03:23:23.889194 9724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c59746be37840f599c778d668f26555" candidate_uuid: "335ad26d715c4362a2151f8118ceae67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f3b80f633eb41098342ad15e5911f3e" is_pre_election: true
I20260809 03:23:23.889346 9724 raft_consensus.cc:2454] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 335ad26d715c4362a2151f8118ceae67 in term 0.
I20260809 03:23:23.889346 9879 raft_consensus.cc:2454] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 335ad26d715c4362a2151f8118ceae67 in term 0.
I20260809 03:23:23.889621 9505 leader_election.cc:302] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 335ad26d715c4362a2151f8118ceae67, 8cd5d11f5f4841539173cff8c0df8a34; no voters:
I20260809 03:23:23.889763 9966 raft_consensus.cc:2781] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:23:23.889820 9966 raft_consensus.cc:482] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:23:23.889843 9966 raft_consensus.cc:3037] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:23.891057 9966 raft_consensus.cc:504] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } }
I20260809 03:23:23.891201 9966 leader_election.cc:288] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [CANDIDATE]: Term 1 election: Requested vote from peers 2f3b80f633eb41098342ad15e5911f3e (127.8.5.194:46147), 8cd5d11f5f4841539173cff8c0df8a34 (127.8.5.195:46069)
I20260809 03:23:23.891510 9879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c59746be37840f599c778d668f26555" candidate_uuid: "335ad26d715c4362a2151f8118ceae67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd5d11f5f4841539173cff8c0df8a34"
I20260809 03:23:23.891510 9724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c59746be37840f599c778d668f26555" candidate_uuid: "335ad26d715c4362a2151f8118ceae67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f3b80f633eb41098342ad15e5911f3e"
I20260809 03:23:23.891598 9879 raft_consensus.cc:3037] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:23.891598 9724 raft_consensus.cc:3037] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:23.892715 9724 raft_consensus.cc:2454] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 335ad26d715c4362a2151f8118ceae67 in term 1.
I20260809 03:23:23.892952 9506 leader_election.cc:302] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f3b80f633eb41098342ad15e5911f3e, 335ad26d715c4362a2151f8118ceae67; no voters:
I20260809 03:23:23.893064 9966 raft_consensus.cc:2781] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:23.893186 9966 raft_consensus.cc:686] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [term 1 LEADER]: Becoming Leader. State: Replica: 335ad26d715c4362a2151f8118ceae67, State: Running, Role: LEADER
I20260809 03:23:23.893217 9879 raft_consensus.cc:2454] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 335ad26d715c4362a2151f8118ceae67 in term 1.
I20260809 03:23:23.893283 9966 consensus_queue.cc:237] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } }
I20260809 03:23:23.894296 9408 catalog_manager.cc:5495] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 335ad26d715c4362a2151f8118ceae67 (127.8.5.193). New cstate: current_term: 1 leader_uuid: "335ad26d715c4362a2151f8118ceae67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } health_report { overall_health: HEALTHY } } }
I20260809 03:23:23.943643 9957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:23.940984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53370 (local address 127.8.5.193:45185)
0809 03:23:23.941048 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:23.941051 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:23.941060 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:23:23.941150 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:23.941151 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:23.941172 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:23.941242 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:23.941406 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.941887 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.942732 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:23.942940 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:23.943053 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:23.943294 (+ 241us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:23.943391 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:23.943479 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:23.943529 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 03:23:23.943552 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 03:23:23.945785 9724 raft_consensus.cc:1261] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e [term 1 FOLLOWER]: Refusing update from remote peer 335ad26d715c4362a2151f8118ceae67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:23.945785 9879 raft_consensus.cc:1261] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34 [term 1 FOLLOWER]: Refusing update from remote peer 335ad26d715c4362a2151f8118ceae67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:23.946259 9970 consensus_queue.cc:1035] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:23.946430 9966 consensus_queue.cc:1035] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:23.949179 9973 mvcc.cc:205] Tried to move back new op lower bound from 7316462812958711808 to 7316462812747677696. Current Snapshot: MvccSnapshot[applied={T|T < 7316462812958711808}]
I20260809 03:23:23.949295 9974 mvcc.cc:205] Tried to move back new op lower bound from 7316462812958711808 to 7316462812747677696. Current Snapshot: MvccSnapshot[applied={T|T < 7316462812958711808}]
I20260809 03:23:23.949997 9975 mvcc.cc:205] Tried to move back new op lower bound from 7316462812958711808 to 7316462812747677696. Current Snapshot: MvccSnapshot[applied={T|T < 7316462812958711808}]
I20260809 03:23:23.953647 9408 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52726:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:23.953783 9408 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52726:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:23.954658 9408 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852: Sending DeleteTablet for 3 replicas of tablet 4c59746be37840f599c778d668f26555
I20260809 03:23:23.955181 9859 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c59746be37840f599c778d668f26555 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:23 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:33396
I20260809 03:23:23.955327 9553 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c59746be37840f599c778d668f26555 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:23 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:53368
I20260809 03:23:23.955693 9985 tablet_replica.cc:330] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67: stopping tablet replica
I20260809 03:23:23.955648 9408 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52726:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 03:23:23.955785 9985 raft_consensus.cc:2229] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [term 1 LEADER]: Raft consensus shutting down.
W20260809 03:23:23.955806 9408 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:23:23.955904 9985 raft_consensus.cc:2258] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:23.956861 9984 tablet_replica.cc:330] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34: stopping tablet replica
I20260809 03:23:23.956964 9553 tablet_service.cc:1467] Processing CreateTablet for tablet bf52afdaa2804f0aab33e4d799042c6d (DEFAULT_TABLE table=test-table [id=f44ef2a7ea554604b019a62a894d6ea0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:23.957044 9859 tablet_service.cc:1467] Processing CreateTablet for tablet bf52afdaa2804f0aab33e4d799042c6d (DEFAULT_TABLE table=test-table [id=f44ef2a7ea554604b019a62a894d6ea0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:23.957103 9553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf52afdaa2804f0aab33e4d799042c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:23.957082 9984 raft_consensus.cc:2229] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:23.957206 9859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf52afdaa2804f0aab33e4d799042c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:23.957368 9702 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c59746be37840f599c778d668f26555 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:23 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:37618
I20260809 03:23:23.957448 9984 raft_consensus.cc:2258] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:23.958490 9984 ts_tablet_manager.cc:1905] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:23.959106 9958 tablet_bootstrap.cc:492] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34: Bootstrap starting.
I20260809 03:23:23.959424 9702 tablet_service.cc:1467] Processing CreateTablet for tablet bf52afdaa2804f0aab33e4d799042c6d (DEFAULT_TABLE table=test-table [id=f44ef2a7ea554604b019a62a894d6ea0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:23.959542 9702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf52afdaa2804f0aab33e4d799042c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:23.959607 9958 tablet_bootstrap.cc:654] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:23.959668 9962 tablet_bootstrap.cc:492] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67: Bootstrap starting.
I20260809 03:23:23.960963 9962 tablet_bootstrap.cc:654] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:23.961695 9959 tablet_bootstrap.cc:492] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e: Bootstrap starting.
I20260809 03:23:23.962008 9984 ts_tablet_manager.cc:1918] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:23:23.962097 9984 log.cc:1196] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/4c59746be37840f599c778d668f26555
I20260809 03:23:23.962456 9984 ts_tablet_manager.cc:1939] T 4c59746be37840f599c778d668f26555 P 8cd5d11f5f4841539173cff8c0df8a34: Deleting consensus metadata
I20260809 03:23:23.962850 9959 tablet_bootstrap.cc:654] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:23.963164 9392 catalog_manager.cc:4841] TS 8cd5d11f5f4841539173cff8c0df8a34 (127.8.5.195:46069): tablet 4c59746be37840f599c778d668f26555 (table test-table [id=ad4fb3d3ca54437e973e51d2f55e5d43]) successfully deleted
I20260809 03:23:23.963374 9958 tablet_bootstrap.cc:492] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34: No bootstrap required, opened a new log
I20260809 03:23:23.963428 9958 ts_tablet_manager.cc:1397] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260809 03:23:23.963579 9958 raft_consensus.cc:348] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } }
I20260809 03:23:23.963654 9958 raft_consensus.cc:374] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:23.963670 9958 raft_consensus.cc:729] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd5d11f5f4841539173cff8c0df8a34, State: Initialized, Role: FOLLOWER
I20260809 03:23:23.963647 9962 tablet_bootstrap.cc:492] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67: No bootstrap required, opened a new log
I20260809 03:23:23.963719 9962 ts_tablet_manager.cc:1397] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260809 03:23:23.963726 9958 consensus_queue.cc:260] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } }
I20260809 03:23:23.963824 9958 ts_tablet_manager.cc:1428] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 03:23:23.963956 9962 raft_consensus.cc:348] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } }
I20260809 03:23:23.964093 9962 raft_consensus.cc:374] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:23.964121 9962 raft_consensus.cc:729] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 335ad26d715c4362a2151f8118ceae67, State: Initialized, Role: FOLLOWER
I20260809 03:23:23.964169 9962 consensus_queue.cc:260] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } }
I20260809 03:23:23.964278 9962 ts_tablet_manager.cc:1428] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 03:23:23.964740 9985 ts_tablet_manager.cc:1905] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:23.966354 9985 ts_tablet_manager.cc:1918] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:23:23.966431 9985 log.cc:1196] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/wal/wals/4c59746be37840f599c778d668f26555
I20260809 03:23:23.966596 9959 tablet_bootstrap.cc:492] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e: No bootstrap required, opened a new log
I20260809 03:23:23.966665 9959 ts_tablet_manager.cc:1397] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260809 03:23:23.966714 9985 ts_tablet_manager.cc:1939] T 4c59746be37840f599c778d668f26555 P 335ad26d715c4362a2151f8118ceae67: Deleting consensus metadata
I20260809 03:23:23.966825 9959 raft_consensus.cc:348] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } }
I20260809 03:23:23.966919 9959 raft_consensus.cc:374] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:23.966948 9959 raft_consensus.cc:729] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f3b80f633eb41098342ad15e5911f3e, State: Initialized, Role: FOLLOWER
I20260809 03:23:23.967031 9959 consensus_queue.cc:260] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } }
I20260809 03:23:23.967126 9959 ts_tablet_manager.cc:1428] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 03:23:23.967175 9390 catalog_manager.cc:4841] TS 335ad26d715c4362a2151f8118ceae67 (127.8.5.193:45185): tablet 4c59746be37840f599c778d668f26555 (table test-table [id=ad4fb3d3ca54437e973e51d2f55e5d43]) successfully deleted
I20260809 03:23:23.967348 9986 tablet_replica.cc:330] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e: stopping tablet replica
I20260809 03:23:23.967475 9986 raft_consensus.cc:2229] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:23.967589 9986 raft_consensus.cc:2258] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:23.968020 9986 ts_tablet_manager.cc:1905] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:23.969319 9986 ts_tablet_manager.cc:1918] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:23:23.969403 9986 log.cc:1196] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/4c59746be37840f599c778d668f26555
I20260809 03:23:23.969640 9986 ts_tablet_manager.cc:1939] T 4c59746be37840f599c778d668f26555 P 2f3b80f633eb41098342ad15e5911f3e: Deleting consensus metadata
I20260809 03:23:23.970078 9393 catalog_manager.cc:4841] TS 2f3b80f633eb41098342ad15e5911f3e (127.8.5.194:46147): tablet 4c59746be37840f599c778d668f26555 (table test-table [id=ad4fb3d3ca54437e973e51d2f55e5d43]) successfully deleted
I20260809 03:23:24.087582 9964 raft_consensus.cc:482] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:23:24.087693 9964 raft_consensus.cc:504] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } }
I20260809 03:23:24.088119 9964 leader_election.cc:288] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 335ad26d715c4362a2151f8118ceae67 (127.8.5.193:45185), 8cd5d11f5f4841539173cff8c0df8a34 (127.8.5.195:46069)
I20260809 03:23:24.091871 9992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.088307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:46069 (local address 127.8.5.194:53605)
0809 03:23:24.088429 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:24.088443 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:24.088522 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:24.088688 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:24.088690 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:24.088692 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:24.088775 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:24.088778 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.089444 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.089445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:24.090706 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:24.090709 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.091564 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.091566 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:24.091644 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.091649 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 03:23:24.091730 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 03:23:24.091770 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":70,"threads_started":1}
I20260809 03:23:24.091946 9956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.088480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:53605 (local address 127.8.5.195:46069)
0809 03:23:24.088523 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:24.088525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:24.088534 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:23:24.088595 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:24.088596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:24.088606 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:24.088681 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:24.088886 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.089360 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.090861 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.091451 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.091519 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.091530 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:24.091764 (+ 234us) server_negotiation.cc:299] Negotiation successful
0809 03:23:24.091878 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:23:24.092000 9957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.088413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:38147 (local address 127.8.5.193:45185)
0809 03:23:24.088471 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:24.088473 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:24.088514 (+ 41us) server_negotiation.cc:407] Connection header received
0809 03:23:24.088598 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:24.088599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:24.088607 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:24.088678 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:24.088872 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.089338 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.090669 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.091525 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.091592 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.091601 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:24.091887 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 03:23:24.091929 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 03:23:24.092279 9991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.088307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:45185 (local address 127.8.5.194:38147)
0809 03:23:24.088457 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:24.088469 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:24.088532 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:24.088684 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:24.088685 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:24.088690 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:24.088779 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:24.088781 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.089427 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.089428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:24.090566 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:24.090570 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.091639 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.091640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:24.091758 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.091788 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 03:23:24.092139 (+ 351us) client_negotiation.cc:240] Negotiation successful
0809 03:23:24.092192 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":2,"thread_start_us":74,"threads_started":1}
I20260809 03:23:24.092455 9879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf52afdaa2804f0aab33e4d799042c6d" candidate_uuid: "2f3b80f633eb41098342ad15e5911f3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd5d11f5f4841539173cff8c0df8a34" is_pre_election: true
I20260809 03:23:24.092553 9879 raft_consensus.cc:2454] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f3b80f633eb41098342ad15e5911f3e in term 0.
I20260809 03:23:24.092767 9653 leader_election.cc:302] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f3b80f633eb41098342ad15e5911f3e, 8cd5d11f5f4841539173cff8c0df8a34; no voters:
I20260809 03:23:24.092775 9572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf52afdaa2804f0aab33e4d799042c6d" candidate_uuid: "2f3b80f633eb41098342ad15e5911f3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "335ad26d715c4362a2151f8118ceae67" is_pre_election: true
I20260809 03:23:24.092913 9964 raft_consensus.cc:2781] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:23:24.092921 9572 raft_consensus.cc:2454] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f3b80f633eb41098342ad15e5911f3e in term 0.
I20260809 03:23:24.092952 9964 raft_consensus.cc:482] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:23:24.092975 9964 raft_consensus.cc:3037] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:24.093827 9964 raft_consensus.cc:504] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } }
I20260809 03:23:24.093986 9964 leader_election.cc:288] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [CANDIDATE]: Term 1 election: Requested vote from peers 335ad26d715c4362a2151f8118ceae67 (127.8.5.193:45185), 8cd5d11f5f4841539173cff8c0df8a34 (127.8.5.195:46069)
I20260809 03:23:24.094136 9572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf52afdaa2804f0aab33e4d799042c6d" candidate_uuid: "2f3b80f633eb41098342ad15e5911f3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "335ad26d715c4362a2151f8118ceae67"
I20260809 03:23:24.094132 9879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf52afdaa2804f0aab33e4d799042c6d" candidate_uuid: "2f3b80f633eb41098342ad15e5911f3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd5d11f5f4841539173cff8c0df8a34"
I20260809 03:23:24.094221 9572 raft_consensus.cc:3037] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:24.094218 9879 raft_consensus.cc:3037] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:24.094998 9572 raft_consensus.cc:2454] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f3b80f633eb41098342ad15e5911f3e in term 1.
I20260809 03:23:24.095074 9879 raft_consensus.cc:2454] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f3b80f633eb41098342ad15e5911f3e in term 1.
I20260809 03:23:24.095233 9651 leader_election.cc:302] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f3b80f633eb41098342ad15e5911f3e, 335ad26d715c4362a2151f8118ceae67; no voters:
I20260809 03:23:24.095363 9964 raft_consensus.cc:2781] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:24.095503 9964 raft_consensus.cc:686] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [term 1 LEADER]: Becoming Leader. State: Replica: 2f3b80f633eb41098342ad15e5911f3e, State: Running, Role: LEADER
I20260809 03:23:24.095571 9964 consensus_queue.cc:237] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } }
I20260809 03:23:24.096295 9407 catalog_manager.cc:5495] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f3b80f633eb41098342ad15e5911f3e (127.8.5.194). New cstate: current_term: 1 leader_uuid: "2f3b80f633eb41098342ad15e5911f3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } health_report { overall_health: UNKNOWN } } }
Aug 09 03:23:24 dist-test-slave-2w3w krb5kdc[9360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245803, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:24.126853 9462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.119669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52740 (local address 127.8.5.254:33681)
0809 03:23:24.119818 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:24.119820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:24.119903 (+ 83us) server_negotiation.cc:407] Connection header received
0809 03:23:24.119954 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:24.119954 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:24.119964 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:24.120006 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:24.120489 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.121027 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.121817 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.121998 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.122059 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.124169 (+ 2110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:24.124170 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:24.124171 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:24.124178 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:24.125545 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:24.125942 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:24.125943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:24.125944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:24.126013 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:24.126207 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:24.126208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:24.126208 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:24.126317 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:24.126390 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:24.126563 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 03:23:24.126719 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":88,"server-negotiator.queue_time_us":124}
I20260809 03:23:24.126945 10002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.119607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33681 (local address 127.0.0.1:52740)
0809 03:23:24.119815 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:24.119826 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:24.119898 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:24.120025 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:24.120026 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:24.120323 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:24.120369 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:24.120371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.121117 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.121118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:24.121738 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:24.121745 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.122068 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.122069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:24.122113 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.122654 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:24.122659 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:24.124076 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:24.125628 (+ 1552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:24.125636 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:24.125639 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:24.125852 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:24.126081 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:24.126082 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:24.126082 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:24.126142 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:24.126395 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:24.126404 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:24.126449 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 03:23:24.126528 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 03:23:24.126650 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":75,"threads_started":1}
I20260809 03:23:24.129125 9407 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:52740:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 03:23:24.129426 9407 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:23:24.130949 9702 tablet_service.cc:1467] Processing CreateTablet for tablet 1e5128fa8f704b96bb051e709c12cb14 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=196fe56804864274944cba197a45987b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 03:23:24.130947 9553 tablet_service.cc:1467] Processing CreateTablet for tablet 1e5128fa8f704b96bb051e709c12cb14 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=196fe56804864274944cba197a45987b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 03:23:24.131173 9702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e5128fa8f704b96bb051e709c12cb14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:24.131204 9553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e5128fa8f704b96bb051e709c12cb14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:24.133605 9962 tablet_bootstrap.cc:492] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67: Bootstrap starting.
I20260809 03:23:24.133661 9959 tablet_bootstrap.cc:492] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e: Bootstrap starting.
I20260809 03:23:24.130939 9859 tablet_service.cc:1467] Processing CreateTablet for tablet 1e5128fa8f704b96bb051e709c12cb14 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=196fe56804864274944cba197a45987b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 03:23:24.133985 9962 tablet_bootstrap.cc:654] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:24.134017 9859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e5128fa8f704b96bb051e709c12cb14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:24.134076 9959 tablet_bootstrap.cc:654] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:24.134589 9962 tablet_bootstrap.cc:492] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67: No bootstrap required, opened a new log
I20260809 03:23:24.134644 9962 ts_tablet_manager.cc:1397] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260809 03:23:24.134783 9962 raft_consensus.cc:348] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } }
I20260809 03:23:24.134869 9962 raft_consensus.cc:374] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:24.134895 9962 raft_consensus.cc:729] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 335ad26d715c4362a2151f8118ceae67, State: Initialized, Role: FOLLOWER
I20260809 03:23:24.134955 9962 consensus_queue.cc:260] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } }
I20260809 03:23:24.135027 9959 tablet_bootstrap.cc:492] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e: No bootstrap required, opened a new log
I20260809 03:23:24.135069 9959 ts_tablet_manager.cc:1397] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 03:23:24.135087 9978 tablet_replica.cc:439] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } }
I20260809 03:23:24.135178 9978 tablet_replica.cc:442] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:24.135201 9959 raft_consensus.cc:348] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } }
I20260809 03:23:24.135274 9959 raft_consensus.cc:374] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:24.135295 9959 raft_consensus.cc:729] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f3b80f633eb41098342ad15e5911f3e, State: Initialized, Role: FOLLOWER
I20260809 03:23:24.135075 9962 ts_tablet_manager.cc:1428] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:24.135351 9959 consensus_queue.cc:260] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } }
I20260809 03:23:24.135454 9959 ts_tablet_manager.cc:1428] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:24.135509 9964 tablet_replica.cc:439] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } }
I20260809 03:23:24.135608 9964 tablet_replica.cc:442] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:24.135628 9958 tablet_bootstrap.cc:492] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34: Bootstrap starting.
I20260809 03:23:24.136458 9958 tablet_bootstrap.cc:654] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:24.137143 9958 tablet_bootstrap.cc:492] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34: No bootstrap required, opened a new log
I20260809 03:23:24.137187 9958 ts_tablet_manager.cc:1397] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 03:23:24.137331 9958 raft_consensus.cc:348] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } }
I20260809 03:23:24.137384 9958 raft_consensus.cc:374] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:24.137398 9958 raft_consensus.cc:729] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd5d11f5f4841539173cff8c0df8a34, State: Initialized, Role: FOLLOWER
I20260809 03:23:24.137463 9958 consensus_queue.cc:260] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } }
I20260809 03:23:24.137573 9958 ts_tablet_manager.cc:1428] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:24.137620 9963 tablet_replica.cc:439] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } }
I20260809 03:23:24.137748 9963 tablet_replica.cc:442] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:24.188736 9963 raft_consensus.cc:482] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:23:24.188853 9963 raft_consensus.cc:504] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } }
I20260809 03:23:24.189250 9963 leader_election.cc:288] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 335ad26d715c4362a2151f8118ceae67 (127.8.5.193:45185), 2f3b80f633eb41098342ad15e5911f3e (127.8.5.194:46147)
I20260809 03:23:24.192672 10007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.189441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:46147 (local address 127.8.5.195:55619)
0809 03:23:24.189575 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:24.189585 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:24.189649 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:24.189834 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:24.189835 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:24.189837 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:24.189923 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:24.189926 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.190695 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.190696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:24.191886 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:24.191889 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.192395 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.192396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:24.192478 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.192482 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:23:24.192524 (+ 42us) client_negotiation.cc:240] Negotiation successful
0809 03:23:24.192555 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":29,"thread_start_us":68,"threads_started":1}
I20260809 03:23:24.192685 9955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.189578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:55619 (local address 127.8.5.194:46147)
0809 03:23:24.189629 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:24.189631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:24.189641 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:23:24.189732 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:24.189734 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:24.189744 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:24.189811 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:24.190022 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.190613 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.191964 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.192292 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.192384 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.192395 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:24.192554 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 03:23:24.192602 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 03:23:24.192745 9957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.189515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:43145 (local address 127.8.5.193:45185)
0809 03:23:24.189567 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:24.189569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:24.189668 (+ 99us) server_negotiation.cc:407] Connection header received
0809 03:23:24.189773 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:24.189774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:24.189785 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:24.189900 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:24.190096 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.190622 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.191892 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.192282 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.192338 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.192368 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:24.192627 (+ 259us) server_negotiation.cc:299] Negotiation successful
0809 03:23:24.192669 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 03:23:24.192898 10006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.189441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:45185 (local address 127.8.5.195:43145)
0809 03:23:24.189603 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:24.189614 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:24.189694 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:24.189923 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:24.189924 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:24.189927 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:24.190025 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:24.190026 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.190702 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.190703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:24.191811 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:24.191813 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.192392 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.192393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:24.192542 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.192547 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 03:23:24.192608 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 03:23:24.192644 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":32,"thread_start_us":86,"threads_started":1}
I20260809 03:23:24.193197 9724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e5128fa8f704b96bb051e709c12cb14" candidate_uuid: "8cd5d11f5f4841539173cff8c0df8a34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f3b80f633eb41098342ad15e5911f3e" is_pre_election: true
I20260809 03:23:24.193281 9724 raft_consensus.cc:2454] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd5d11f5f4841539173cff8c0df8a34 in term 0.
I20260809 03:23:24.193405 9572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e5128fa8f704b96bb051e709c12cb14" candidate_uuid: "8cd5d11f5f4841539173cff8c0df8a34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "335ad26d715c4362a2151f8118ceae67" is_pre_election: true
I20260809 03:23:24.193490 9572 raft_consensus.cc:2454] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd5d11f5f4841539173cff8c0df8a34 in term 0.
I20260809 03:23:24.193480 9809 leader_election.cc:302] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f3b80f633eb41098342ad15e5911f3e, 8cd5d11f5f4841539173cff8c0df8a34; no voters:
I20260809 03:23:24.193610 9963 raft_consensus.cc:2781] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:23:24.193678 9963 raft_consensus.cc:482] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:23:24.193699 9963 raft_consensus.cc:3037] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:24.194404 9963 raft_consensus.cc:504] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } }
I20260809 03:23:24.194543 9963 leader_election.cc:288] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [CANDIDATE]: Term 1 election: Requested vote from peers 335ad26d715c4362a2151f8118ceae67 (127.8.5.193:45185), 2f3b80f633eb41098342ad15e5911f3e (127.8.5.194:46147)
I20260809 03:23:24.194682 9572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e5128fa8f704b96bb051e709c12cb14" candidate_uuid: "8cd5d11f5f4841539173cff8c0df8a34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "335ad26d715c4362a2151f8118ceae67"
I20260809 03:23:24.194715 9724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e5128fa8f704b96bb051e709c12cb14" candidate_uuid: "8cd5d11f5f4841539173cff8c0df8a34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f3b80f633eb41098342ad15e5911f3e"
I20260809 03:23:24.194778 9572 raft_consensus.cc:3037] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:24.194787 9724 raft_consensus.cc:3037] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:24.195585 9724 raft_consensus.cc:2454] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd5d11f5f4841539173cff8c0df8a34 in term 1.
I20260809 03:23:24.195642 9572 raft_consensus.cc:2454] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd5d11f5f4841539173cff8c0df8a34 in term 1.
I20260809 03:23:24.195791 9806 leader_election.cc:302] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 335ad26d715c4362a2151f8118ceae67, 8cd5d11f5f4841539173cff8c0df8a34; no voters:
I20260809 03:23:24.195894 9963 raft_consensus.cc:2781] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:24.196022 9963 raft_consensus.cc:686] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [term 1 LEADER]: Becoming Leader. State: Replica: 8cd5d11f5f4841539173cff8c0df8a34, State: Running, Role: LEADER
I20260809 03:23:24.196105 9963 consensus_queue.cc:237] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } }
I20260809 03:23:24.196453 10008 tablet_replica.cc:439] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34: TxnStatusTablet state changed. Reason: New leader 8cd5d11f5f4841539173cff8c0df8a34. Latest consensus state: current_term: 1 leader_uuid: "8cd5d11f5f4841539173cff8c0df8a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } }
I20260809 03:23:24.196558 10008 tablet_replica.cc:442] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34: This TxnStatusTablet replica's current role is: LEADER
I20260809 03:23:24.196755 10010 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 03:23:24.196880 10010 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 03:23:24.196931 9408 catalog_manager.cc:5495] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cd5d11f5f4841539173cff8c0df8a34 (127.8.5.195). New cstate: current_term: 1 leader_uuid: "8cd5d11f5f4841539173cff8c0df8a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } health_report { overall_health: HEALTHY } } }
I20260809 03:23:24.211354 9956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.208710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33398 (local address 127.8.5.195:46069)
0809 03:23:24.208762 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:24.208764 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:24.208773 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:23:24.208863 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:24.208864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:24.208879 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:24.208937 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:24.209085 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.209536 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.210627 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.210794 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.210841 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.211049 (+ 208us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:24.211133 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:24.211184 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:24.211258 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 03:23:24.211273 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 03:23:24.211390 10002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.208638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:46069 (local address 127.0.0.1:33398)
0809 03:23:24.208723 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:24.208733 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:24.208776 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:24.208964 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:24.208965 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:24.208967 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 03:23:24.209020 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:24.209022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.209607 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.209608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:24.210546 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:24.210549 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.210865 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.210866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:24.210928 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.210946 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 03:23:24.211194 (+ 248us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 03:23:24.211202 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 03:23:24.211257 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 03:23:24.211307 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 03:23:24.212512 9724 raft_consensus.cc:1261] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e [term 1 FOLLOWER]: Refusing update from remote peer 8cd5d11f5f4841539173cff8c0df8a34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:24.212638 9572 raft_consensus.cc:1261] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67 [term 1 FOLLOWER]: Refusing update from remote peer 8cd5d11f5f4841539173cff8c0df8a34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:24.212766 9963 consensus_queue.cc:1035] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:24.212936 9963 consensus_queue.cc:1035] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:24.213379 9964 tablet_replica.cc:439] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e: TxnStatusTablet state changed. Reason: New leader 8cd5d11f5f4841539173cff8c0df8a34. Latest consensus state: current_term: 1 leader_uuid: "8cd5d11f5f4841539173cff8c0df8a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } }
I20260809 03:23:24.213479 9964 tablet_replica.cc:442] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:24.213567 9978 tablet_replica.cc:439] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67: TxnStatusTablet state changed. Reason: New leader 8cd5d11f5f4841539173cff8c0df8a34. Latest consensus state: current_term: 1 leader_uuid: "8cd5d11f5f4841539173cff8c0df8a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } }
I20260809 03:23:24.213660 9978 tablet_replica.cc:442] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:24.214227 9963 tablet_replica.cc:439] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8cd5d11f5f4841539173cff8c0df8a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } }
I20260809 03:23:24.214308 9963 tablet_replica.cc:442] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34: This TxnStatusTablet replica's current role is: LEADER
I20260809 03:23:24.214272 9978 tablet_replica.cc:439] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8cd5d11f5f4841539173cff8c0df8a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } }
I20260809 03:23:24.214347 9978 tablet_replica.cc:442] T 1e5128fa8f704b96bb051e709c12cb14 P 335ad26d715c4362a2151f8118ceae67: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:24.215646 10015 tablet_replica.cc:439] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8cd5d11f5f4841539173cff8c0df8a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } }
I20260809 03:23:24.215799 9964 tablet_replica.cc:439] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8cd5d11f5f4841539173cff8c0df8a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 } } peers { permanent_uuid: "2f3b80f633eb41098342ad15e5911f3e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46147 } } peers { permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 } } }
I20260809 03:23:24.215890 9964 tablet_replica.cc:442] T 1e5128fa8f704b96bb051e709c12cb14 P 2f3b80f633eb41098342ad15e5911f3e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:24.215914 10015 tablet_replica.cc:442] T 1e5128fa8f704b96bb051e709c12cb14 P 8cd5d11f5f4841539173cff8c0df8a34: This TxnStatusTablet replica's current role is: LEADER
I20260809 03:23:24.219319 9955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.216509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37632 (local address 127.8.5.194:46147)
0809 03:23:24.216563 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:24.216565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:24.216573 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:23:24.216651 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:24.216652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:24.216671 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:24.216747 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:24.216880 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.217613 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.218459 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.218754 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.218825 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.218930 (+ 105us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:24.219079 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:24.219147 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:24.219234 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 03:23:24.219250 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:23:24.224437 10019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.221580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:46069 (local address 127.8.5.194:47081)
0809 03:23:24.221745 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:24.221754 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:24.221828 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:24.221974 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:24.221975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:24.221976 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 03:23:24.222039 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:24.222040 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.222876 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.222877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:24.223568 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:24.223570 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.224043 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.224044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:24.224133 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.224146 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 03:23:24.224311 (+ 165us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 03:23:24.224313 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:23:24.224350 (+ 37us) client_negotiation.cc:240] Negotiation successful
0809 03:23:24.224381 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":85,"threads_started":1}
I20260809 03:23:24.224433 9956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.221641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:47081 (local address 127.8.5.195:46069)
0809 03:23:24.221702 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:24.221704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:24.221826 (+ 122us) server_negotiation.cc:407] Connection header received
0809 03:23:24.221901 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:24.221902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:24.221912 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:24.221969 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:24.222098 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.222785 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.223646 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.223947 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.224038 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.224222 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:24.224253 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:24.224305 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:24.224352 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 03:23:24.224369 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 03:23:24.226591 9572 raft_consensus.cc:1261] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67 [term 1 FOLLOWER]: Refusing update from remote peer 2f3b80f633eb41098342ad15e5911f3e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:24.226715 9879 raft_consensus.cc:1261] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34 [term 1 FOLLOWER]: Refusing update from remote peer 2f3b80f633eb41098342ad15e5911f3e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:24.226999 9993 consensus_queue.cc:1035] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd5d11f5f4841539173cff8c0df8a34" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:24.227133 9964 consensus_queue.cc:1035] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "335ad26d715c4362a2151f8118ceae67" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:24.237733 9955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.235041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:50199 (local address 127.8.5.194:46147)
0809 03:23:24.235090 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:24.235092 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:24.235243 (+ 151us) server_negotiation.cc:407] Connection header received
0809 03:23:24.235317 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:24.235317 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:24.235325 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:24.235372 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:24.235517 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.235950 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.237076 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.237251 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.237299 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.237533 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:24.237558 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:24.237591 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:24.237668 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 03:23:24.237682 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:23:24.237807 10025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.235029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:46147 (local address 127.8.5.195:50199)
0809 03:23:24.235186 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:24.235197 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:24.235260 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:24.235384 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:24.235384 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:24.235386 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 03:23:24.235463 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:24.235465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.236013 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.236014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:24.236989 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:24.236992 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.237316 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.237317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:24.237432 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.237448 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 03:23:24.237610 (+ 162us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 03:23:24.237613 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:23:24.237667 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 03:23:24.237709 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":82,"threads_started":1}
I20260809 03:23:24.246727 9407 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52726:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:24.246846 9407 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52726:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:24.247519 9407 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2893644eab334b4ab0da66a5e9cb3852: Sending DeleteTablet for 3 replicas of tablet bf52afdaa2804f0aab33e4d799042c6d
I20260809 03:23:24.247876 9553 tablet_service.cc:1514] Processing DeleteTablet for tablet bf52afdaa2804f0aab33e4d799042c6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:24 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:53368
I20260809 03:23:24.247980 9702 tablet_service.cc:1514] Processing DeleteTablet for tablet bf52afdaa2804f0aab33e4d799042c6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:24 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:37618
I20260809 03:23:24.247993 9985 tablet_replica.cc:330] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67: stopping tablet replica
I20260809 03:23:24.248059 9986 tablet_replica.cc:330] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e: stopping tablet replica
I20260809 03:23:24.248063 9985 raft_consensus.cc:2229] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:24.248100 9985 raft_consensus.cc:2258] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:24.248101 9986 raft_consensus.cc:2229] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:23:24.248175 9986 raft_consensus.cc:2258] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:24.248383 9859 tablet_service.cc:1514] Processing DeleteTablet for tablet bf52afdaa2804f0aab33e4d799042c6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:24 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:33396
I20260809 03:23:24.248422 9985 ts_tablet_manager.cc:1905] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:24.248472 9984 tablet_replica.cc:330] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34: stopping tablet replica
I20260809 03:23:24.248514 9984 raft_consensus.cc:2229] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:24.248549 9984 raft_consensus.cc:2258] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:24.249779 9986 ts_tablet_manager.cc:1905] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:24.250154 9985 ts_tablet_manager.cc:1918] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 03:23:24.250205 9985 log.cc:1196] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-0/wal/wals/bf52afdaa2804f0aab33e4d799042c6d
I20260809 03:23:24.250419 9985 ts_tablet_manager.cc:1939] T bf52afdaa2804f0aab33e4d799042c6d P 335ad26d715c4362a2151f8118ceae67: Deleting consensus metadata
I20260809 03:23:24.250768 9390 catalog_manager.cc:4841] TS 335ad26d715c4362a2151f8118ceae67 (127.8.5.193:45185): tablet bf52afdaa2804f0aab33e4d799042c6d (table test-table [id=f44ef2a7ea554604b019a62a894d6ea0]) successfully deleted
I20260809 03:23:24.251374 9986 ts_tablet_manager.cc:1918] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 03:23:24.251435 9986 log.cc:1196] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/bf52afdaa2804f0aab33e4d799042c6d
I20260809 03:23:24.251644 9986 ts_tablet_manager.cc:1939] T bf52afdaa2804f0aab33e4d799042c6d P 2f3b80f633eb41098342ad15e5911f3e: Deleting consensus metadata
I20260809 03:23:24.251963 9393 catalog_manager.cc:4841] TS 2f3b80f633eb41098342ad15e5911f3e (127.8.5.194:46147): tablet bf52afdaa2804f0aab33e4d799042c6d (table test-table [id=f44ef2a7ea554604b019a62a894d6ea0]) successfully deleted
I20260809 03:23:24.252007 9984 ts_tablet_manager.cc:1905] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:24.253522 9984 ts_tablet_manager.cc:1918] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 03:23:24.253585 9984 log.cc:1196] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/bf52afdaa2804f0aab33e4d799042c6d
I20260809 03:23:24.253809 9984 ts_tablet_manager.cc:1939] T bf52afdaa2804f0aab33e4d799042c6d P 8cd5d11f5f4841539173cff8c0df8a34: Deleting consensus metadata
I20260809 03:23:24.254134 9392 catalog_manager.cc:4841] TS 8cd5d11f5f4841539173cff8c0df8a34 (127.8.5.195:46069): tablet bf52afdaa2804f0aab33e4d799042c6d (table test-table [id=f44ef2a7ea554604b019a62a894d6ea0]) successfully deleted
Aug 09 03:23:24 dist-test-slave-2w3w krb5kdc[9360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245803, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.5.193@KRBTEST.COM
I20260809 03:23:24.265327 9957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.251398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53376 (local address 127.8.5.193:45185)
0809 03:23:24.251447 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:24.251449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:24.255127 (+ 3678us) server_negotiation.cc:407] Connection header received
0809 03:23:24.255236 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:24.255237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:24.255249 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:24.255320 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:24.256024 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.256773 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.257991 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.258299 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.258372 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.262042 (+ 3670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:24.262054 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:24.262054 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:24.262063 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:24.264059 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:24.264457 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:24.264461 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:24.264461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:24.264530 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:24.264737 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:24.264738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:24.264738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:24.264919 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:24.265059 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:24.265142 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 03:23:24.265227 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
W20260809 03:23:24.265904 9617 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53376
I20260809 03:23:24.278108 9462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:24.266926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52750 (local address 127.8.5.254:33681)
0809 03:23:24.267051 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:24.267053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:24.270710 (+ 3657us) server_negotiation.cc:407] Connection header received
0809 03:23:24.270779 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:24.270780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:24.270792 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:24.270852 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:24.271535 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.272289 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.273325 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:24.273649 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:24.273726 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:24.275221 (+ 1495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:24.275222 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:24.275222 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:24.275230 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:24.276860 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:24.277264 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:24.277266 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:24.277266 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:24.277332 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:24.277549 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:24.277550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:24.277550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:24.277688 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:24.277787 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:24.277925 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 03:23:24.278006 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260809 03:23:24.278682 9407 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52750
I20260809 03:23:24.279445 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 9486
I20260809 03:23:24.288852 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 9634
I20260809 03:23:24.294942 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 9786
I20260809 03:23:24.301031 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 9373
2026-08-09T03:23:24Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2508 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:23:24 dist-test-slave-2w3w krb5kdc[10034](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:23:24 dist-test-slave-2w3w krb5kdc[10034](info): set up 2 sockets
Aug 09 03:23:24 dist-test-slave-2w3w krb5kdc[10034](info): commencing operation
krb5kdc: starting...
W20260809 03:23:25.380139 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:23:25 dist-test-slave-2w3w krb5kdc[10034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:23:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:23:25.500180 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:38563
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:38563
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:25.580842 10047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:25.581070 10047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:25.581107 10047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:25.582219 10047 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:25.582293 10047 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 03:23:25.582314 10047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:25.582335 10047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:25.582356 10047 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:25.582386 10047 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:23:25.583847 10047 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:38563
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:38563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:25.584113 10047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:25.584333 10047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:25.589084 10054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:25.589109 10057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:25.589140 10053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:25.589349 10047 server_base.cc:1034] running on GCE node
I20260809 03:23:25.589569 10047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:25.589838 10047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:25.591070 10047 hybrid_clock.cc:648] HybridClock initialized: now 1786245805591057 us; error 30 us; skew 500 ppm
Aug 09 03:23:25 dist-test-slave-2w3w krb5kdc[10034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245805, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:25.593576 10047 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:23:25.594059 10047 webserver.cc:460] Webserver started at http://127.8.5.254:44891/ using document root <none> and password file <none>
I20260809 03:23:25.594298 10047 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:25.594348 10047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:25.594521 10047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:25.595654 10047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "a55d9304a6474134a03a024cc5cab8cc"
format_stamp: "Formatted at 2026-08-09 03:23:25 on dist-test-slave-2w3w"
server_key: "1438f85c6f457ee4396e0d4d5be3bcd8"
server_key_iv: "e1c986eccd4b5a123ac658db30d58743"
server_key_version: "encryptionkey@0"
I20260809 03:23:25.596017 10047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "a55d9304a6474134a03a024cc5cab8cc"
format_stamp: "Formatted at 2026-08-09 03:23:25 on dist-test-slave-2w3w"
server_key: "1438f85c6f457ee4396e0d4d5be3bcd8"
server_key_iv: "e1c986eccd4b5a123ac658db30d58743"
server_key_version: "encryptionkey@0"
I20260809 03:23:25.597354 10047 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:23:25.598097 10064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:25.598284 10047 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:25.598460 10047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "a55d9304a6474134a03a024cc5cab8cc"
format_stamp: "Formatted at 2026-08-09 03:23:25 on dist-test-slave-2w3w"
server_key: "1438f85c6f457ee4396e0d4d5be3bcd8"
server_key_iv: "e1c986eccd4b5a123ac658db30d58743"
server_key_version: "encryptionkey@0"
I20260809 03:23:25.598587 10047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:25.613876 10047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:25.616149 10047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:25.616313 10047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:25.621086 10047 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:38563
I20260809 03:23:25.621165 10131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:38563 every 8 connection(s)
I20260809 03:23:25.621475 10047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:25.622078 10132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:25.624294 10132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc: Bootstrap starting.
I20260809 03:23:25.624828 10132 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:25.625099 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 10047
I20260809 03:23:25.625159 10132 log.cc:824] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:25.625221 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:23:25.625391 8215 external_mini_cluster.cc:1428] Setting key 3e12d276456f54ce1344276771c996f2
I20260809 03:23:25.625937 10132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc: No bootstrap required, opened a new log
I20260809 03:23:25.628800 10132 raft_consensus.cc:348] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55d9304a6474134a03a024cc5cab8cc" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38563 } }
I20260809 03:23:25.628959 10132 raft_consensus.cc:374] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:25.628990 10132 raft_consensus.cc:729] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a55d9304a6474134a03a024cc5cab8cc, State: Initialized, Role: FOLLOWER
I20260809 03:23:25.629101 10132 consensus_queue.cc:260] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55d9304a6474134a03a024cc5cab8cc" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38563 } }
I20260809 03:23:25.629169 10132 raft_consensus.cc:388] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:25.629194 10132 raft_consensus.cc:482] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:25.629242 10132 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:25.629863 10132 raft_consensus.cc:504] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55d9304a6474134a03a024cc5cab8cc" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38563 } }
I20260809 03:23:25.629969 10132 leader_election.cc:302] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a55d9304a6474134a03a024cc5cab8cc; no voters:
I20260809 03:23:25.630159 10132 leader_election.cc:288] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:23:25.630208 10137 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:25.630345 10137 raft_consensus.cc:686] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc [term 1 LEADER]: Becoming Leader. State: Replica: a55d9304a6474134a03a024cc5cab8cc, State: Running, Role: LEADER
I20260809 03:23:25.630420 10132 sys_catalog.cc:564] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:25.630441 10137 consensus_queue.cc:237] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55d9304a6474134a03a024cc5cab8cc" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38563 } }
I20260809 03:23:25.630759 10137 sys_catalog.cc:455] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader a55d9304a6474134a03a024cc5cab8cc. Latest consensus state: current_term: 1 leader_uuid: "a55d9304a6474134a03a024cc5cab8cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55d9304a6474134a03a024cc5cab8cc" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38563 } } }
I20260809 03:23:25.630844 10137 sys_catalog.cc:458] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:25.630770 10138 sys_catalog.cc:455] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a55d9304a6474134a03a024cc5cab8cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55d9304a6474134a03a024cc5cab8cc" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38563 } } }
I20260809 03:23:25.631083 10138 sys_catalog.cc:458] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc [sys.catalog]: This master's current role is: LEADER
W20260809 03:23:25.632375 10154 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:23:25.632480 10154 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:23:25.632594 10144 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:25.632833 10144 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 03:23:25 dist-test-slave-2w3w krb5kdc[10034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:25.634146 10144 catalog_manager.cc:1347] Generated new cluster ID: 76c300b7d5024d74acbea0fbc1a33383
I20260809 03:23:25.634196 10144 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:23:25.637327 10136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:25.625892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33658 (local address 127.8.5.254:38563)
0809 03:23:25.626155 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:25.626164 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:25.626195 (+ 31us) server_negotiation.cc:407] Connection header received
0809 03:23:25.627346 (+ 1151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:25.627354 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:25.627416 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:25.627569 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:25.628181 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:25.629541 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:25.630576 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:25.631227 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:25.631300 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:25.634066 (+ 2766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:25.634070 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:25.634070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:25.634080 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:25.635810 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:25.636200 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:25.636203 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:25.636203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:25.636302 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:25.636530 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:25.636531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:25.636531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:25.636755 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:25.636909 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:25.637023 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 03:23:25.637156 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":106,"threads_started":1}
I20260809 03:23:25.642079 10144 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:23:25.642635 10144 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:25.648901 10144 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc: Generated new TSK 0
I20260809 03:23:25.649086 10144 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
I20260809 03:23:25.685456 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:38563
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:25.784307 10161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:25.784541 10161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:25.784585 10161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:25.785820 10161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:25.785882 10161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:25.785919 10161 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 03:23:25.785941 10161 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 03:23:25.785983 10161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:23:25.787541 10161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.5.254:38563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:25.787796 10161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:25.788021 10161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:25.793431 10169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:25.793560 10161 server_base.cc:1034] running on GCE node
W20260809 03:23:25.793434 10167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:25.793685 10166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:25.793910 10161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:25.794178 10161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:25.795337 10161 hybrid_clock.cc:648] HybridClock initialized: now 1786245805795322 us; error 33 us; skew 500 ppm
Aug 09 03:23:25 dist-test-slave-2w3w krb5kdc[10034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245805, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:25.797771 10161 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:23:25.798144 10161 webserver.cc:460] Webserver started at http://127.8.5.193:34175/ using document root <none> and password file <none>
I20260809 03:23:25.798337 10161 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:25.798375 10161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:25.798465 10161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:25.799500 10161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "53325eef37064d61b4c1e6ff915cd94c"
format_stamp: "Formatted at 2026-08-09 03:23:25 on dist-test-slave-2w3w"
server_key: "c6a95e8065b78c829c80a0409b3f914d"
server_key_iv: "2c9b873db7759e490e947daf78b27736"
server_key_version: "encryptionkey@0"
I20260809 03:23:25.799791 10161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "53325eef37064d61b4c1e6ff915cd94c"
format_stamp: "Formatted at 2026-08-09 03:23:25 on dist-test-slave-2w3w"
server_key: "c6a95e8065b78c829c80a0409b3f914d"
server_key_iv: "2c9b873db7759e490e947daf78b27736"
server_key_version: "encryptionkey@0"
I20260809 03:23:25.801136 10161 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:23:25.801844 10177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:25.802011 10161 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:25.802080 10161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "53325eef37064d61b4c1e6ff915cd94c"
format_stamp: "Formatted at 2026-08-09 03:23:25 on dist-test-slave-2w3w"
server_key: "c6a95e8065b78c829c80a0409b3f914d"
server_key_iv: "2c9b873db7759e490e947daf78b27736"
server_key_version: "encryptionkey@0"
I20260809 03:23:25.802172 10161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:25.811143 10161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:25.812904 10161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:25.813056 10161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:25.813521 10161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:25.813555 10161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:25.813580 10161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:25.813632 10161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 03:23:25 dist-test-slave-2w3w krb5kdc[10034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245805, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:25.820832 10161 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:40363
I20260809 03:23:25.820910 10303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:40363 every 8 connection(s)
I20260809 03:23:25.821193 10161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:23:25.824292 10136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:25.814027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:34707 (local address 127.8.5.254:38563)
0809 03:23:25.814091 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:25.814093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:25.814296 (+ 203us) server_negotiation.cc:407] Connection header received
0809 03:23:25.814805 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:25.814806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:25.814818 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:25.814871 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:25.815746 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:25.816568 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:25.818274 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:25.818608 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:25.818699 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:25.821280 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:25.821282 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:25.821282 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:25.821290 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:25.822810 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:25.823288 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:25.823290 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:25.823291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:25.823358 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:25.823616 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:25.823617 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:25.823617 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:25.823734 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:25.823804 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:25.824108 (+ 304us) server_negotiation.cc:299] Negotiation successful
0809 03:23:25.824199 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 03:23:25.824426 10187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:25.814003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38563 (local address 127.8.5.193:34707)
0809 03:23:25.814172 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:25.814212 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:25.814694 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:25.814951 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:25.814955 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:25.815352 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:25.815657 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:25.815665 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:25.816692 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:25.816693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:25.818169 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:25.818172 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:25.818717 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:25.818718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:25.818862 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:25.819321 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:25.819331 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:25.821182 (+ 1851us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:25.822915 (+ 1733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:25.822923 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:25.822925 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:25.823196 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:25.823427 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:25.823428 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:25.823428 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:25.823542 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:25.823807 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:25.823814 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:25.823954 (+ 140us) client_negotiation.cc:769] Sending connection context
0809 03:23:25.824052 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 03:23:25.824209 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":92,"threads_started":1}
I20260809 03:23:25.824952 10304 heartbeater.cc:347] Connected to a master server at 127.8.5.254:38563
I20260809 03:23:25.825034 10304 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:25.825213 10304 heartbeater.cc:511] Master 127.8.5.254:38563 requested a full tablet report, sending...
I20260809 03:23:25.825687 10082 ts_manager.cc:194] Registered new tserver with Master: 53325eef37064d61b4c1e6ff915cd94c (127.8.5.193:40363)
I20260809 03:23:25.826576 10082 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:34707
I20260809 03:23:25.831130 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 10161
I20260809 03:23:25.831193 10136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:25.826003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:55699 (local address 127.8.5.254:38563)
0809 03:23:25.826057 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:25.826059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:25.826182 (+ 123us) server_negotiation.cc:407] Connection header received
0809 03:23:25.826206 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:25.826207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:25.826216 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:25.826278 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:25.826558 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:25.827223 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:25.827937 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:25.828100 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:25.828146 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:25.828979 (+ 833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:25.828980 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:25.828980 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:25.828984 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:25.830064 (+ 1080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:25.830350 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:25.830351 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:25.830351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:25.830406 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:25.830657 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:25.830657 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:25.830658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:25.830751 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:25.830803 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:25.831028 (+ 225us) server_negotiation.cc:299] Negotiation successful
0809 03:23:25.831104 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:23:25.831205 10310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:25.825948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38563 (local address 127.8.5.193:55699)
0809 03:23:25.826112 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:25.826126 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:25.826173 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:25.826280 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:25.826281 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:25.826421 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:25.826471 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:25.826472 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:25.827311 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:25.827312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:25.827871 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:25.827873 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:25.828158 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:25.828159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:25.828213 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:25.828640 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:25.828645 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:25.828912 (+ 267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:25.830132 (+ 1220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:25.830133 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:25.830133 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:25.830290 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:25.830504 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:25.830505 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:25.830505 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:25.830595 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:25.830810 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:25.830810 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:25.830888 (+ 78us) client_negotiation.cc:769] Sending connection context
0809 03:23:25.831008 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 03:23:25.831105 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":72,"threads_started":1}
I20260809 03:23:25.831238 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:23:25.831466 8215 external_mini_cluster.cc:1428] Setting key ec8374aa4f9da6a8b6aa8a6ab115bb67
WARNING: no policy specified for kudu/127.8.5.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
I20260809 03:23:25.857834 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:38563
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:25.938390 10313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:25.938577 10313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:25.938601 10313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:25.939687 10313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:25.939723 10313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:25.939742 10313 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 03:23:25.939761 10313 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 03:23:25.939778 10313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:23:25.941126 10313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.5.254:38563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:25.941289 10313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:25.941455 10313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:25.946297 10321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:25.946314 10318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:25.946305 10319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:25.946518 10313 server_base.cc:1034] running on GCE node
I20260809 03:23:25.946704 10313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:25.946904 10313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:25.948069 10313 hybrid_clock.cc:648] HybridClock initialized: now 1786245805948061 us; error 32 us; skew 500 ppm
Aug 09 03:23:25 dist-test-slave-2w3w krb5kdc[10034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245805, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:25.950443 10313 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:23:25.950862 10313 webserver.cc:460] Webserver started at http://127.8.5.194:41695/ using document root <none> and password file <none>
I20260809 03:23:25.951114 10313 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:25.951185 10313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:25.951346 10313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:25.952343 10313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "6a3830c836da4a20aa915f9463be93a1"
format_stamp: "Formatted at 2026-08-09 03:23:25 on dist-test-slave-2w3w"
server_key: "8a0c0254f3ede91d67ef147d71f0ded4"
server_key_iv: "8ae7c1d464c6caa46b15d15b8d6ddd65"
server_key_version: "encryptionkey@0"
I20260809 03:23:25.952713 10313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "6a3830c836da4a20aa915f9463be93a1"
format_stamp: "Formatted at 2026-08-09 03:23:25 on dist-test-slave-2w3w"
server_key: "8a0c0254f3ede91d67ef147d71f0ded4"
server_key_iv: "8ae7c1d464c6caa46b15d15b8d6ddd65"
server_key_version: "encryptionkey@0"
I20260809 03:23:25.954021 10313 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:23:25.954691 10328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:25.954885 10313 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:25.955005 10313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "6a3830c836da4a20aa915f9463be93a1"
format_stamp: "Formatted at 2026-08-09 03:23:25 on dist-test-slave-2w3w"
server_key: "8a0c0254f3ede91d67ef147d71f0ded4"
server_key_iv: "8ae7c1d464c6caa46b15d15b8d6ddd65"
server_key_version: "encryptionkey@0"
I20260809 03:23:25.955080 10313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:25.981570 10313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:25.983726 10313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:25.983928 10313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:25.984519 10313 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:25.984591 10313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:25.984632 10313 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:25.984686 10313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 03:23:25 dist-test-slave-2w3w krb5kdc[10034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245805, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:25.992350 10313 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:35513
I20260809 03:23:25.992434 10457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:35513 every 8 connection(s)
I20260809 03:23:25.992857 10313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:23:25.995415 10136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:25.985048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:43863 (local address 127.8.5.254:38563)
0809 03:23:25.985127 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:25.985129 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:25.985338 (+ 209us) server_negotiation.cc:407] Connection header received
0809 03:23:25.985972 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:25.985973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:25.985986 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:25.986046 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:25.986911 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:25.987892 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:25.989424 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:25.989705 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:25.989793 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:25.992444 (+ 2651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:25.992445 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:25.992446 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:25.992454 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:25.993994 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:25.994387 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:25.994388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:25.994389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:25.994444 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:25.994701 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:25.994702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:25.994702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:25.994857 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:25.994938 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:25.995232 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 03:23:25.995325 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 03:23:25.995571 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:25.985013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38563 (local address 127.8.5.194:43863)
0809 03:23:25.985200 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:25.985239 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:25.985864 (+ 625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:25.986118 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:25.986122 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:25.986505 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:25.986772 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:25.986779 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:25.988004 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:25.988005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:25.989326 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:25.989329 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:25.989824 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:25.989825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:25.989968 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:25.990544 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:25.990551 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:25.992310 (+ 1759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:25.994078 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:25.994085 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:25.994087 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:25.994294 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:25.994516 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:25.994517 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:25.994517 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:25.994634 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:25.994929 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:25.994935 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:25.995090 (+ 155us) client_negotiation.cc:769] Sending connection context
0809 03:23:25.995199 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 03:23:25.995353 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":97,"threads_started":1}
I20260809 03:23:25.996062 10458 heartbeater.cc:347] Connected to a master server at 127.8.5.254:38563
I20260809 03:23:25.996161 10458 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:25.996345 10458 heartbeater.cc:511] Master 127.8.5.254:38563 requested a full tablet report, sending...
I20260809 03:23:25.996726 10082 ts_manager.cc:194] Registered new tserver with Master: 6a3830c836da4a20aa915f9463be93a1 (127.8.5.194:35513)
I20260809 03:23:25.997197 10082 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:43863
I20260809 03:23:26.002027 10136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:25.997165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:59045 (local address 127.8.5.254:38563)
0809 03:23:25.997206 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:25.997208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:25.997298 (+ 90us) server_negotiation.cc:407] Connection header received
0809 03:23:25.997351 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:25.997351 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:25.997362 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:25.997421 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:25.997777 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:25.998226 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:25.998873 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:25.999137 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:25.999190 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:25.999923 (+ 733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:25.999924 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:25.999924 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:25.999930 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:26.001054 (+ 1124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:26.001392 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:26.001393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:26.001393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:26.001460 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:26.001637 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:26.001637 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:26.001638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:26.001768 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:26.001818 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.001911 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.001971 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 03:23:26.002032 10464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:25.997075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38563 (local address 127.8.5.194:59045)
0809 03:23:25.997217 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:25.997229 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:25.997292 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:25.997424 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:25.997424 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:25.997640 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:25.997703 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:25.997705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:25.998309 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:25.998309 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:25.998797 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:25.998799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:25.999213 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:25.999214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:25.999269 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:25.999597 (+ 328us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:25.999600 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:25.999850 (+ 250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:26.001123 (+ 1273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:26.001124 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:26.001124 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:26.001282 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:26.001527 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:26.001528 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:26.001528 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:26.001582 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:26.001809 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:26.001810 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:26.001846 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 03:23:26.001892 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 03:23:26.001966 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":91,"threads_started":1}
I20260809 03:23:26.002727 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 10313
I20260809 03:23:26.002827 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:23:26.003049 8215 external_mini_cluster.cc:1428] Setting key a026287ed9c7c3374dc53e575bdaf4fe
WARNING: no policy specified for kudu/127.8.5.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
I20260809 03:23:26.029402 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:38563
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:26.110579 10467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:26.110798 10467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:26.110848 10467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:26.112027 10467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:26.112093 10467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:26.112130 10467 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 03:23:26.112159 10467 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 03:23:26.112191 10467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:23:26.113602 10467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.5.254:38563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:26.113876 10467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:26.114096 10467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:26.119030 10473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:26.119077 10472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:26.119091 10467 server_base.cc:1034] running on GCE node
W20260809 03:23:26.118974 10475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:26.119386 10467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:26.119578 10467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:26.120723 10467 hybrid_clock.cc:648] HybridClock initialized: now 1786245806120700 us; error 36 us; skew 500 ppm
Aug 09 03:23:26 dist-test-slave-2w3w krb5kdc[10034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245806, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:26.123139 10467 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:23:26.123592 10467 webserver.cc:460] Webserver started at http://127.8.5.195:45763/ using document root <none> and password file <none>
I20260809 03:23:26.123811 10467 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:26.123875 10467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:26.124007 10467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:26.125063 10467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "e5f20941487a4384b197f36334175ce8"
format_stamp: "Formatted at 2026-08-09 03:23:26 on dist-test-slave-2w3w"
server_key: "c13ab15f41fb28b20ea30263e2f79d2d"
server_key_iv: "879eb3978c850215c959c2673c7be057"
server_key_version: "encryptionkey@0"
I20260809 03:23:26.125432 10467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "e5f20941487a4384b197f36334175ce8"
format_stamp: "Formatted at 2026-08-09 03:23:26 on dist-test-slave-2w3w"
server_key: "c13ab15f41fb28b20ea30263e2f79d2d"
server_key_iv: "879eb3978c850215c959c2673c7be057"
server_key_version: "encryptionkey@0"
I20260809 03:23:26.126928 10467 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:23:26.127686 10483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:26.127897 10467 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:26.128008 10467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "e5f20941487a4384b197f36334175ce8"
format_stamp: "Formatted at 2026-08-09 03:23:26 on dist-test-slave-2w3w"
server_key: "c13ab15f41fb28b20ea30263e2f79d2d"
server_key_iv: "879eb3978c850215c959c2673c7be057"
server_key_version: "encryptionkey@0"
I20260809 03:23:26.128089 10467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:26.153162 10467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:26.154924 10467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:26.155104 10467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:26.155645 10467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:26.155706 10467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:26.155745 10467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:26.155766 10467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 03:23:26 dist-test-slave-2w3w krb5kdc[10034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245806, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:26.163122 10467 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:45617
I20260809 03:23:26.163419 10607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:45617 every 8 connection(s)
I20260809 03:23:26.163537 10467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:23:26.164084 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 10467
I20260809 03:23:26.164160 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:23:26.164346 8215 external_mini_cluster.cc:1428] Setting key eb109b756bd1029824892849c8ddb707
I20260809 03:23:26.165877 10136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.156035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:51809 (local address 127.8.5.254:38563)
0809 03:23:26.156110 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.156112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.156376 (+ 264us) server_negotiation.cc:407] Connection header received
0809 03:23:26.157108 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.157110 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.157124 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.157191 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:26.158116 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.159000 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.159997 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.160205 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.160277 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.162795 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:26.162797 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:26.162798 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:26.162805 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:26.164586 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:26.165087 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:26.165088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:26.165088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:26.165156 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:26.165378 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:26.165379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:26.165379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:26.165480 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:26.165525 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.165704 (+ 179us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.165797 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 03:23:26.165992 10492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.156023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38563 (local address 127.8.5.195:51809)
0809 03:23:26.156219 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:26.156272 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:26.156986 (+ 714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:26.157267 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:26.157272 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:26.157675 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:26.158012 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.158020 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.159094 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.159095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.159887 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.159889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.160310 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.160312 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.160432 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.160927 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:26.160946 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:26.162689 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:26.164660 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:26.164667 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:26.164669 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:26.164977 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:26.165218 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:26.165219 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:26.165219 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:26.165320 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:26.165522 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:26.165524 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:26.165621 (+ 97us) client_negotiation.cc:769] Sending connection context
0809 03:23:26.165689 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 03:23:26.165797 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":100,"threads_started":1}
I20260809 03:23:26.166406 10608 heartbeater.cc:347] Connected to a master server at 127.8.5.254:38563
I20260809 03:23:26.166479 10608 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:26.166654 10608 heartbeater.cc:511] Master 127.8.5.254:38563 requested a full tablet report, sending...
I20260809 03:23:26.167034 10082 ts_manager.cc:194] Registered new tserver with Master: e5f20941487a4384b197f36334175ce8 (127.8.5.195:45617)
I20260809 03:23:26.167502 10082 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:51809
I20260809 03:23:26.172590 10136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.167496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:41783 (local address 127.8.5.254:38563)
0809 03:23:26.167532 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.167534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.167610 (+ 76us) server_negotiation.cc:407] Connection header received
0809 03:23:26.167736 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.167737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.167747 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.167802 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:26.168122 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.168580 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.169271 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.169475 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.169557 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.170345 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:26.170346 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:26.170346 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:26.170353 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:26.171489 (+ 1136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:26.171816 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:26.171817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:26.171817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:26.171873 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:26.172094 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:26.172095 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:26.172095 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:26.172205 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:26.172275 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.172432 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.172501 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 03:23:26.172606 10615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.167400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38563 (local address 127.8.5.195:41783)
0809 03:23:26.167543 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:26.167554 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:26.167650 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:26.167808 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:26.167808 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:26.167987 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:26.168047 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.168048 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.168673 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.168674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.169174 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.169176 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.169559 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.169560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.169638 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.169981 (+ 343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:26.169985 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:26.170238 (+ 253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:26.171580 (+ 1342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:26.171581 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:26.171581 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:26.171741 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:26.171965 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:26.171966 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:26.171966 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:26.172027 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:26.172278 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:26.172279 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:26.172321 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 03:23:26.172405 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 03:23:26.172503 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":92,"threads_started":1}
I20260809 03:23:26.175746 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 03:23:26 dist-test-slave-2w3w krb5kdc[10034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 03:23:26 dist-test-slave-2w3w krb5kdc[10034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:26.199177 10136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.192228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33670 (local address 127.8.5.254:38563)
0809 03:23:26.192290 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.192292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.192301 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:23:26.192355 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.192356 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.192365 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.192415 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:26.192977 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.193445 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.194145 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.194322 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.194370 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.196784 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:26.196785 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:26.196785 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:26.196791 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:26.198184 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:26.198493 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:26.198494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:26.198494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:26.198544 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:26.198714 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:26.198714 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:26.198715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:26.198843 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:26.198916 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.199055 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.199114 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 03:23:26.200718 10082 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33670:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:23:26.202258 10082 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:23:26.208770 10629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.204529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:35513 (local address 127.0.0.1:45300)
0809 03:23:26.204779 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:26.204823 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:26.204895 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:26.205143 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:26.205146 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:26.205148 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:26.205211 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.205213 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.206335 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.206335 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.207733 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.207737 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.208434 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.208435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.208526 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.208537 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 03:23:26.208638 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 03:23:26.208696 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":6,"thread_start_us":65,"threads_started":1}
I20260809 03:23:26.208810 10631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.204668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45300 (local address 127.8.5.194:35513)
0809 03:23:26.204980 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.204985 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.204996 (+ 11us) server_negotiation.cc:407] Connection header received
0809 03:23:26.205036 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.205038 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.205055 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.205146 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:26.205331 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.206254 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.207827 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.208331 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.208430 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.208493 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.208663 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.208706 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":77,"threads_started":1}
I20260809 03:23:26.209636 10633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.204583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:45617 (local address 127.0.0.1:48784)
0809 03:23:26.204855 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:26.204864 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:26.204904 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:26.205484 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:26.205485 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:26.205487 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:26.205532 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.205533 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.206838 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.206839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.208073 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.208076 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.209398 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.209399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.209456 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.209460 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:23:26.209512 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 03:23:26.209549 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":83,"threads_started":1}
I20260809 03:23:26.209724 10628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.204734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:40363 (local address 127.0.0.1:46160)
0809 03:23:26.204990 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:26.204998 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:26.205029 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:26.205453 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:26.205453 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:26.205455 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:26.205491 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.205493 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.207004 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.207004 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.208521 (+ 1517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.208524 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.209516 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.209517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.209573 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.209575 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:23:26.209620 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 03:23:26.209653 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":70,"threads_started":1}
I20260809 03:23:26.209662 10382 tablet_service.cc:1467] Processing CreateTablet for tablet 8871b756d92945b79a1e0055ccdffb0e (DEFAULT_TABLE table=test-table [id=bf41fbcdfd944f2e880f3577a87a39a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:26.209662 10632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.204697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48784 (local address 127.8.5.195:45617)
0809 03:23:26.205312 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.205316 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.205324 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:23:26.205370 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.205372 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.205387 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.205607 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:26.205667 (+ 60us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.206739 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.208172 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.209295 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.209367 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.209421 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.209532 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.209566 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":96,"threads_started":1}
I20260809 03:23:26.209998 10634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.204953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46160 (local address 127.8.5.193:40363)
0809 03:23:26.205137 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.205142 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.205151 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:23:26.205223 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.205237 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.205253 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.205379 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:26.205557 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.206866 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.208604 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.209359 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.209424 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.209483 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.209859 (+ 376us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.209906 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":86,"threads_started":1}
I20260809 03:23:26.210076 10382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8871b756d92945b79a1e0055ccdffb0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:26.210640 10233 tablet_service.cc:1467] Processing CreateTablet for tablet 8871b756d92945b79a1e0055ccdffb0e (DEFAULT_TABLE table=test-table [id=bf41fbcdfd944f2e880f3577a87a39a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:26.210995 10233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8871b756d92945b79a1e0055ccdffb0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:26.211516 10536 tablet_service.cc:1467] Processing CreateTablet for tablet 8871b756d92945b79a1e0055ccdffb0e (DEFAULT_TABLE table=test-table [id=bf41fbcdfd944f2e880f3577a87a39a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:26.211809 10536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8871b756d92945b79a1e0055ccdffb0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:26.213919 10635 tablet_bootstrap.cc:492] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1: Bootstrap starting.
I20260809 03:23:26.214772 10635 tablet_bootstrap.cc:654] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:26.214766 10637 tablet_bootstrap.cc:492] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c: Bootstrap starting.
I20260809 03:23:26.215121 10636 tablet_bootstrap.cc:492] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8: Bootstrap starting.
I20260809 03:23:26.215153 10635 log.cc:824] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:26.215421 10637 tablet_bootstrap.cc:654] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:26.215672 10637 log.cc:824] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:26.216037 10636 tablet_bootstrap.cc:654] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:26.216050 10635 tablet_bootstrap.cc:492] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1: No bootstrap required, opened a new log
I20260809 03:23:26.216135 10635 ts_tablet_manager.cc:1397] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:23:26.216391 10636 log.cc:824] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:26.216446 10637 tablet_bootstrap.cc:492] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c: No bootstrap required, opened a new log
I20260809 03:23:26.216503 10637 ts_tablet_manager.cc:1397] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:23:26.217238 10636 tablet_bootstrap.cc:492] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8: No bootstrap required, opened a new log
I20260809 03:23:26.217314 10636 ts_tablet_manager.cc:1397] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:23:26.217911 10635 raft_consensus.cc:348] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.218055 10635 raft_consensus.cc:374] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:26.218098 10635 raft_consensus.cc:729] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a3830c836da4a20aa915f9463be93a1, State: Initialized, Role: FOLLOWER
I20260809 03:23:26.218220 10635 consensus_queue.cc:260] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.218492 10635 ts_tablet_manager.cc:1428] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 03:23:26.218616 10458 heartbeater.cc:503] Master 127.8.5.254:38563 was elected leader, sending a full tablet report...
I20260809 03:23:26.218532 10637 raft_consensus.cc:348] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.218680 10637 raft_consensus.cc:374] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:26.218724 10637 raft_consensus.cc:729] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53325eef37064d61b4c1e6ff915cd94c, State: Initialized, Role: FOLLOWER
I20260809 03:23:26.218865 10637 consensus_queue.cc:260] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.219157 10637 ts_tablet_manager.cc:1428] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 03:23:26.219178 10304 heartbeater.cc:503] Master 127.8.5.254:38563 was elected leader, sending a full tablet report...
I20260809 03:23:26.219275 10636 raft_consensus.cc:348] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.219439 10636 raft_consensus.cc:374] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:26.219488 10636 raft_consensus.cc:729] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f20941487a4384b197f36334175ce8, State: Initialized, Role: FOLLOWER
I20260809 03:23:26.219597 10636 consensus_queue.cc:260] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.219877 10636 ts_tablet_manager.cc:1428] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 03:23:26.220016 10608 heartbeater.cc:503] Master 127.8.5.254:38563 was elected leader, sending a full tablet report...
I20260809 03:23:26.241648 10642 raft_consensus.cc:482] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:23:26.241739 10642 raft_consensus.cc:504] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.242121 10642 leader_election.cc:288] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53325eef37064d61b4c1e6ff915cd94c (127.8.5.193:40363), e5f20941487a4384b197f36334175ce8 (127.8.5.195:45617)
W20260809 03:23:26.243525 10459 tablet.cc:2369] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:23:26.245648 10634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.242329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:55869 (local address 127.8.5.193:40363)
0809 03:23:26.242380 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.242382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.242519 (+ 137us) server_negotiation.cc:407] Connection header received
0809 03:23:26.242542 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.242543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.242552 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.242614 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:26.242778 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.243303 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.244710 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.245293 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.245361 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.245373 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.245542 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.245580 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 03:23:26.245647 10632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.242396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:58575 (local address 127.8.5.195:45617)
0809 03:23:26.242437 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.242439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.242552 (+ 113us) server_negotiation.cc:407] Connection header received
0809 03:23:26.242622 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.242622 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.242632 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.242713 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:26.242885 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.243442 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.244709 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.245279 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.245365 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.245373 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.245542 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.245580 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 03:23:26.245664 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.242292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:40363 (local address 127.8.5.194:55869)
0809 03:23:26.242399 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:26.242412 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:26.242463 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:26.242619 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:26.242619 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:26.242621 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:26.242693 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.242695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.243391 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.243392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.244618 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.244620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.245375 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.245376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.245458 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.245460 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:23:26.245518 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 03:23:26.245572 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"mutex_wait_us":12}
I20260809 03:23:26.245677 10645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.242303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:45617 (local address 127.8.5.194:58575)
0809 03:23:26.242486 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:26.242494 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:26.242570 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:26.242718 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:26.242719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:26.242721 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:26.242800 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.242801 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.243523 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.243523 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.244618 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.244620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.245376 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.245376 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.245455 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.245459 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:23:26.245518 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 03:23:26.245572 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":33,"thread_start_us":110,"threads_started":1}
I20260809 03:23:26.246021 10256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8871b756d92945b79a1e0055ccdffb0e" candidate_uuid: "6a3830c836da4a20aa915f9463be93a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53325eef37064d61b4c1e6ff915cd94c" is_pre_election: true
I20260809 03:23:26.246150 10256 raft_consensus.cc:2454] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a3830c836da4a20aa915f9463be93a1 in term 0.
I20260809 03:23:26.246126 10558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8871b756d92945b79a1e0055ccdffb0e" candidate_uuid: "6a3830c836da4a20aa915f9463be93a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f20941487a4384b197f36334175ce8" is_pre_election: true
I20260809 03:23:26.246273 10558 raft_consensus.cc:2454] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a3830c836da4a20aa915f9463be93a1 in term 0.
I20260809 03:23:26.246378 10331 leader_election.cc:302] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53325eef37064d61b4c1e6ff915cd94c, 6a3830c836da4a20aa915f9463be93a1; no voters:
I20260809 03:23:26.246506 10642 raft_consensus.cc:2781] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:23:26.246562 10642 raft_consensus.cc:482] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:23:26.246591 10642 raft_consensus.cc:3037] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:26.247570 10642 raft_consensus.cc:504] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.247769 10642 leader_election.cc:288] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [CANDIDATE]: Term 1 election: Requested vote from peers 53325eef37064d61b4c1e6ff915cd94c (127.8.5.193:40363), e5f20941487a4384b197f36334175ce8 (127.8.5.195:45617)
I20260809 03:23:26.247867 10558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8871b756d92945b79a1e0055ccdffb0e" candidate_uuid: "6a3830c836da4a20aa915f9463be93a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f20941487a4384b197f36334175ce8"
I20260809 03:23:26.247884 10256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8871b756d92945b79a1e0055ccdffb0e" candidate_uuid: "6a3830c836da4a20aa915f9463be93a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53325eef37064d61b4c1e6ff915cd94c"
I20260809 03:23:26.247946 10558 raft_consensus.cc:3037] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:26.247946 10256 raft_consensus.cc:3037] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:26.248767 10256 raft_consensus.cc:2454] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a3830c836da4a20aa915f9463be93a1 in term 1.
I20260809 03:23:26.248768 10558 raft_consensus.cc:2454] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a3830c836da4a20aa915f9463be93a1 in term 1.
I20260809 03:23:26.248968 10329 leader_election.cc:302] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a3830c836da4a20aa915f9463be93a1, e5f20941487a4384b197f36334175ce8; no voters:
I20260809 03:23:26.249071 10642 raft_consensus.cc:2781] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:26.249229 10642 raft_consensus.cc:686] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [term 1 LEADER]: Becoming Leader. State: Replica: 6a3830c836da4a20aa915f9463be93a1, State: Running, Role: LEADER
I20260809 03:23:26.249326 10642 consensus_queue.cc:237] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.250064 10083 catalog_manager.cc:5495] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a3830c836da4a20aa915f9463be93a1 (127.8.5.194). New cstate: current_term: 1 leader_uuid: "6a3830c836da4a20aa915f9463be93a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
Aug 09 03:23:26 dist-test-slave-2w3w krb5kdc[10034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245805, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:26.286072 10656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.279575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38563 (local address 127.0.0.1:33676)
0809 03:23:26.279773 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:26.279783 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:26.279861 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:26.280009 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:26.280010 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:26.280315 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:26.280369 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.280372 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.281020 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.281021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.281537 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.281538 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.281893 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.281894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.281954 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.282486 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:26.282491 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:26.283823 (+ 1332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:26.285133 (+ 1310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:26.285139 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:26.285141 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:26.285345 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:26.285514 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:26.285515 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:26.285515 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:26.285570 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:26.285765 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:26.285770 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:26.285810 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 03:23:26.285869 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 03:23:26.285956 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":109,"threads_started":1}
I20260809 03:23:26.286082 10136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.279664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33676 (local address 127.8.5.254:38563)
0809 03:23:26.279737 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.279739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.279865 (+ 126us) server_negotiation.cc:407] Connection header received
0809 03:23:26.279916 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.279917 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.279928 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.280005 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:26.280457 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.280939 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.281622 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.281804 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.281893 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.283903 (+ 2010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:26.283904 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:26.283905 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:26.283911 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:26.285063 (+ 1152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:26.285408 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:26.285409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:26.285409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:26.285458 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:26.285620 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:26.285621 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:26.285621 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:26.285715 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:26.285762 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.285902 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.286001 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":47}
I20260809 03:23:26.287985 10083 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:33676:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 03:23:26.288180 10083 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:23:26.289695 10382 tablet_service.cc:1467] Processing CreateTablet for tablet 197afecf97ed41dcbaa8e913036f2cf4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c8d8ae90dedd46aabc4e2be7d68ead4c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 03:23:26.289676 10233 tablet_service.cc:1467] Processing CreateTablet for tablet 197afecf97ed41dcbaa8e913036f2cf4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c8d8ae90dedd46aabc4e2be7d68ead4c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 03:23:26.289733 10536 tablet_service.cc:1467] Processing CreateTablet for tablet 197afecf97ed41dcbaa8e913036f2cf4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c8d8ae90dedd46aabc4e2be7d68ead4c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 03:23:26.289863 10233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 197afecf97ed41dcbaa8e913036f2cf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:26.289867 10536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 197afecf97ed41dcbaa8e913036f2cf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:26.289889 10382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 197afecf97ed41dcbaa8e913036f2cf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:26.291195 10635 tablet_bootstrap.cc:492] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1: Bootstrap starting.
I20260809 03:23:26.291376 10636 tablet_bootstrap.cc:492] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8: Bootstrap starting.
I20260809 03:23:26.291399 10637 tablet_bootstrap.cc:492] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c: Bootstrap starting.
I20260809 03:23:26.291664 10635 tablet_bootstrap.cc:654] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:26.291945 10636 tablet_bootstrap.cc:654] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:26.292002 10637 tablet_bootstrap.cc:654] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:26.292446 10635 tablet_bootstrap.cc:492] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1: No bootstrap required, opened a new log
I20260809 03:23:26.292500 10635 ts_tablet_manager.cc:1397] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:26.292647 10635 raft_consensus.cc:348] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.292748 10635 raft_consensus.cc:374] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:26.292778 10635 raft_consensus.cc:729] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a3830c836da4a20aa915f9463be93a1, State: Initialized, Role: FOLLOWER
I20260809 03:23:26.292800 10637 tablet_bootstrap.cc:492] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c: No bootstrap required, opened a new log
I20260809 03:23:26.292832 10635 consensus_queue.cc:260] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.292867 10637 ts_tablet_manager.cc:1397] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:26.292923 10635 ts_tablet_manager.cc:1428] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:26.292969 10642 tablet_replica.cc:439] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } } }
I20260809 03:23:26.293020 10637 raft_consensus.cc:348] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.293064 10642 tablet_replica.cc:442] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:26.293092 10637 raft_consensus.cc:374] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:26.293116 10637 raft_consensus.cc:729] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53325eef37064d61b4c1e6ff915cd94c, State: Initialized, Role: FOLLOWER
I20260809 03:23:26.293130 10636 tablet_bootstrap.cc:492] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8: No bootstrap required, opened a new log
I20260809 03:23:26.293172 10636 ts_tablet_manager.cc:1397] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:23:26.293162 10637 consensus_queue.cc:260] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.293270 10637 ts_tablet_manager.cc:1428] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:26.293323 10636 raft_consensus.cc:348] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.293308 10643 tablet_replica.cc:439] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } } }
I20260809 03:23:26.293391 10636 raft_consensus.cc:374] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:26.293395 10643 tablet_replica.cc:442] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:26.293419 10636 raft_consensus.cc:729] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f20941487a4384b197f36334175ce8, State: Initialized, Role: FOLLOWER
I20260809 03:23:26.293467 10636 consensus_queue.cc:260] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.293552 10636 ts_tablet_manager.cc:1428] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:26.293618 10644 tablet_replica.cc:439] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } } }
I20260809 03:23:26.293711 10644 tablet_replica.cc:442] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8: This TxnStatusTablet replica's current role is: FOLLOWER
W20260809 03:23:26.321923 10305 tablet.cc:2369] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:23:26.344031 10644 raft_consensus.cc:482] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:23:26.344110 10644 raft_consensus.cc:504] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.344422 10644 leader_election.cc:288] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53325eef37064d61b4c1e6ff915cd94c (127.8.5.193:40363), 6a3830c836da4a20aa915f9463be93a1 (127.8.5.194:35513)
I20260809 03:23:26.347381 10492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.344562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:40363 (local address 127.8.5.195:39645)
0809 03:23:26.344622 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:26.344635 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:26.344709 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:26.344849 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:26.344850 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:26.344852 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:26.344947 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.344949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.345673 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.345673 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.346503 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.346506 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.347127 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.347128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.347216 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.347220 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:23:26.347274 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 03:23:26.347324 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":1}
I20260809 03:23:26.347412 10634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.344665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:39645 (local address 127.8.5.193:40363)
0809 03:23:26.344715 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.344717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.344731 (+ 14us) server_negotiation.cc:407] Connection header received
0809 03:23:26.344761 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.344762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.344772 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.344829 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:26.345063 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.345600 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.346586 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.347001 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.347062 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.347071 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.347287 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.347327 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 03:23:26.347563 10631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.344757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:45595 (local address 127.8.5.194:35513)
0809 03:23:26.344834 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.344836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.344934 (+ 98us) server_negotiation.cc:407] Connection header received
0809 03:23:26.344967 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.344968 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.344998 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.345057 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:26.345211 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.345681 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.346647 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.347159 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.347228 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.347239 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.347431 (+ 192us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.347480 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 03:23:26.347563 10660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.344678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:35513 (local address 127.8.5.195:45595)
0809 03:23:26.344867 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:26.344878 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:26.344932 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:26.345075 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:26.345076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:26.345078 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:26.345146 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.345147 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.345757 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.345758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.346530 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.346532 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.347246 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.347247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.347335 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.347340 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 03:23:26.347411 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 03:23:26.347454 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":49,"thread_start_us":115,"threads_started":1}
I20260809 03:23:26.347654 10256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "197afecf97ed41dcbaa8e913036f2cf4" candidate_uuid: "e5f20941487a4384b197f36334175ce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53325eef37064d61b4c1e6ff915cd94c" is_pre_election: true
I20260809 03:23:26.347755 10256 raft_consensus.cc:2454] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f20941487a4384b197f36334175ce8 in term 0.
I20260809 03:23:26.347957 10486 leader_election.cc:302] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53325eef37064d61b4c1e6ff915cd94c, e5f20941487a4384b197f36334175ce8; no voters:
I20260809 03:23:26.348138 10644 raft_consensus.cc:2781] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:23:26.348114 10404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "197afecf97ed41dcbaa8e913036f2cf4" candidate_uuid: "e5f20941487a4384b197f36334175ce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a3830c836da4a20aa915f9463be93a1" is_pre_election: true
I20260809 03:23:26.348183 10644 raft_consensus.cc:482] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:23:26.348204 10644 raft_consensus.cc:3037] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:26.348228 10404 raft_consensus.cc:2454] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f20941487a4384b197f36334175ce8 in term 0.
I20260809 03:23:26.348965 10644 raft_consensus.cc:504] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.349133 10644 leader_election.cc:288] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [CANDIDATE]: Term 1 election: Requested vote from peers 53325eef37064d61b4c1e6ff915cd94c (127.8.5.193:40363), 6a3830c836da4a20aa915f9463be93a1 (127.8.5.194:35513)
I20260809 03:23:26.349346 10256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "197afecf97ed41dcbaa8e913036f2cf4" candidate_uuid: "e5f20941487a4384b197f36334175ce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53325eef37064d61b4c1e6ff915cd94c"
I20260809 03:23:26.349359 10404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "197afecf97ed41dcbaa8e913036f2cf4" candidate_uuid: "e5f20941487a4384b197f36334175ce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a3830c836da4a20aa915f9463be93a1"
I20260809 03:23:26.349426 10256 raft_consensus.cc:3037] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:26.349426 10404 raft_consensus.cc:3037] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:26.350167 10256 raft_consensus.cc:2454] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f20941487a4384b197f36334175ce8 in term 1.
I20260809 03:23:26.350167 10404 raft_consensus.cc:2454] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f20941487a4384b197f36334175ce8 in term 1.
I20260809 03:23:26.350337 10486 leader_election.cc:302] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a3830c836da4a20aa915f9463be93a1, e5f20941487a4384b197f36334175ce8; no voters:
I20260809 03:23:26.350432 10644 raft_consensus.cc:2781] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:26.350586 10644 raft_consensus.cc:686] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [term 1 LEADER]: Becoming Leader. State: Replica: e5f20941487a4384b197f36334175ce8, State: Running, Role: LEADER
I20260809 03:23:26.350682 10644 consensus_queue.cc:237] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.351150 10661 tablet_replica.cc:439] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8: TxnStatusTablet state changed. Reason: New leader e5f20941487a4384b197f36334175ce8. Latest consensus state: current_term: 1 leader_uuid: "e5f20941487a4384b197f36334175ce8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } } }
I20260809 03:23:26.351229 10661 tablet_replica.cc:442] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8: This TxnStatusTablet replica's current role is: LEADER
I20260809 03:23:26.351469 10663 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 03:23:26.351547 10663 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 03:23:26.351527 10081 catalog_manager.cc:5495] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f20941487a4384b197f36334175ce8 (127.8.5.195). New cstate: current_term: 1 leader_uuid: "e5f20941487a4384b197f36334175ce8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260809 03:23:26.369118 10656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.366371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:45617 (local address 127.0.0.1:48792)
0809 03:23:26.366436 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:26.366448 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:26.366506 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:26.366700 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:26.366700 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:26.366701 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 03:23:26.366744 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.366745 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.367666 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.367666 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.368222 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.368224 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.368665 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.368665 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.368711 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.368725 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 03:23:26.368986 (+ 261us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 03:23:26.368992 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 03:23:26.369026 (+ 34us) client_negotiation.cc:240] Negotiation successful
0809 03:23:26.369062 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260809 03:23:26.369146 10632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.366380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48792 (local address 127.8.5.195:45617)
0809 03:23:26.366420 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.366423 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.366489 (+ 66us) server_negotiation.cc:407] Connection header received
0809 03:23:26.366566 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.366567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.366598 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.366690 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:26.366786 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.367586 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.368296 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.368589 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.368657 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.368802 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:26.368921 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:26.368995 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.369032 (+ 37us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.369053 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:23:26.371167 10404 raft_consensus.cc:1261] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1 [term 1 FOLLOWER]: Refusing update from remote peer e5f20941487a4384b197f36334175ce8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:26.371213 10256 raft_consensus.cc:1261] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c [term 1 FOLLOWER]: Refusing update from remote peer e5f20941487a4384b197f36334175ce8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:26.371500 10644 consensus_queue.cc:1035] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:26.371646 10661 consensus_queue.cc:1035] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:26.372711 10642 tablet_replica.cc:439] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1: TxnStatusTablet state changed. Reason: New leader e5f20941487a4384b197f36334175ce8. Latest consensus state: current_term: 1 leader_uuid: "e5f20941487a4384b197f36334175ce8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } } }
I20260809 03:23:26.372810 10642 tablet_replica.cc:442] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:26.372761 10643 tablet_replica.cc:439] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c: TxnStatusTablet state changed. Reason: New leader e5f20941487a4384b197f36334175ce8. Latest consensus state: current_term: 1 leader_uuid: "e5f20941487a4384b197f36334175ce8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } } }
I20260809 03:23:26.372852 10643 tablet_replica.cc:442] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:26.373723 10661 tablet_replica.cc:439] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5f20941487a4384b197f36334175ce8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } } }
I20260809 03:23:26.373798 10661 tablet_replica.cc:442] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8: This TxnStatusTablet replica's current role is: LEADER
I20260809 03:23:26.373970 10642 tablet_replica.cc:439] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5f20941487a4384b197f36334175ce8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } } }
I20260809 03:23:26.374046 10642 tablet_replica.cc:442] T 197afecf97ed41dcbaa8e913036f2cf4 P 6a3830c836da4a20aa915f9463be93a1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:26.374361 10667 mvcc.cc:205] Tried to move back new op lower bound from 7316462822893793280 to 7316462822812962816. Current Snapshot: MvccSnapshot[applied={T|T < 7316462822893793280}]
I20260809 03:23:26.374571 10644 tablet_replica.cc:439] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5f20941487a4384b197f36334175ce8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } } }
I20260809 03:23:26.374660 10644 tablet_replica.cc:442] T 197afecf97ed41dcbaa8e913036f2cf4 P e5f20941487a4384b197f36334175ce8: This TxnStatusTablet replica's current role is: LEADER
I20260809 03:23:26.375089 10643 tablet_replica.cc:439] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5f20941487a4384b197f36334175ce8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } } }
I20260809 03:23:26.375178 10643 tablet_replica.cc:442] T 197afecf97ed41dcbaa8e913036f2cf4 P 53325eef37064d61b4c1e6ff915cd94c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:26.375622 10668 mvcc.cc:205] Tried to move back new op lower bound from 7316462822893793280 to 7316462822812962816. Current Snapshot: MvccSnapshot[applied={T|T < 7316462822893793280}]
I20260809 03:23:26.378784 10631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.376458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45316 (local address 127.8.5.194:35513)
0809 03:23:26.376507 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.376509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.376518 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:23:26.376587 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.376587 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.376603 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.376684 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:26.376822 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.377274 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.378032 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.378225 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.378297 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.378477 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:26.378566 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:26.378646 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.378688 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.378712 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 03:23:26.383687 10464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.381136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:45617 (local address 127.8.5.194:48747)
0809 03:23:26.381218 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:26.381229 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:26.381271 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:26.381386 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:26.381386 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:26.381387 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 03:23:26.381433 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.381434 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.382278 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.382278 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.382845 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.382846 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.383315 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.383316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.383372 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.383384 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 03:23:26.383565 (+ 181us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 03:23:26.383567 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:23:26.383598 (+ 31us) client_negotiation.cc:240] Negotiation successful
0809 03:23:26.383642 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 03:23:26.383708 10632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.381220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:48747 (local address 127.8.5.195:45617)
0809 03:23:26.381280 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.381282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.381291 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:23:26.381314 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.381315 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.381325 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.381386 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:26.381488 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.382209 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.382922 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.383246 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.383314 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.383474 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:26.383505 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:26.383559 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.383627 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.383644 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 03:23:26.385982 10256 raft_consensus.cc:1261] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c [term 1 FOLLOWER]: Refusing update from remote peer 6a3830c836da4a20aa915f9463be93a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:26.386027 10558 raft_consensus.cc:1261] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8 [term 1 FOLLOWER]: Refusing update from remote peer 6a3830c836da4a20aa915f9463be93a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:26.386279 10646 consensus_queue.cc:1035] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:26.386399 10642 consensus_queue.cc:1035] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:26.388159 10666 mvcc.cc:205] Tried to move back new op lower bound from 7316462822955163648 to 7316462822397833216. Current Snapshot: MvccSnapshot[applied={T|T < 7316462822955163648}]
I20260809 03:23:26.395336 10615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.392449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:35513 (local address 127.8.5.195:36623)
0809 03:23:26.392543 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:26.392554 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:26.392599 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:26.392740 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:26.392741 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:26.392742 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 03:23:26.392797 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.392798 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.393679 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.393680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.394436 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.394438 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.394868 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.394869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.394943 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.394980 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 03:23:26.395180 (+ 200us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 03:23:26.395182 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:23:26.395220 (+ 38us) client_negotiation.cc:240] Negotiation successful
0809 03:23:26.395261 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 03:23:26.395509 10631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.392501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:36623 (local address 127.8.5.194:35513)
0809 03:23:26.392536 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.392538 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.392590 (+ 52us) server_negotiation.cc:407] Connection header received
0809 03:23:26.392660 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.392661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.392671 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.392735 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:26.392857 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.393594 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.394528 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.394796 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.394849 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.395081 (+ 232us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:26.395115 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:26.395159 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.395424 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.395444 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 03:23:26.404412 10081 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33670:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:26.404529 10081 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33670:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:26.405285 10081 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc: Sending DeleteTablet for 3 replicas of tablet 8871b756d92945b79a1e0055ccdffb0e
I20260809 03:23:26.405586 10382 tablet_service.cc:1514] Processing DeleteTablet for tablet 8871b756d92945b79a1e0055ccdffb0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:26 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:45300
I20260809 03:23:26.405730 10536 tablet_service.cc:1514] Processing DeleteTablet for tablet 8871b756d92945b79a1e0055ccdffb0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:26 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:48784
I20260809 03:23:26.405848 10233 tablet_service.cc:1514] Processing DeleteTablet for tablet 8871b756d92945b79a1e0055ccdffb0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:26 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:46160
I20260809 03:23:26.405956 10081 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33670:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 03:23:26.406055 10687 tablet_replica.cc:330] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c: stopping tablet replica
W20260809 03:23:26.406111 10081 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:23:26.406144 10687 raft_consensus.cc:2229] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:26.406201 10687 raft_consensus.cc:2258] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:26.406682 10687 ts_tablet_manager.cc:1905] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:26.407271 10233 tablet_service.cc:1467] Processing CreateTablet for tablet 07f9e473b41b4a519908a25366e9d10e (DEFAULT_TABLE table=test-table [id=dbc7589f027d46e98c88e5b9999cc94d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:26.407410 10233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07f9e473b41b4a519908a25366e9d10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:26.408532 10687 ts_tablet_manager.cc:1918] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 03:23:26.408628 10687 log.cc:1196] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/wal/wals/8871b756d92945b79a1e0055ccdffb0e
I20260809 03:23:26.408728 10382 tablet_service.cc:1467] Processing CreateTablet for tablet 07f9e473b41b4a519908a25366e9d10e (DEFAULT_TABLE table=test-table [id=dbc7589f027d46e98c88e5b9999cc94d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:26.408846 10382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07f9e473b41b4a519908a25366e9d10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:26.408900 10687 ts_tablet_manager.cc:1939] T 8871b756d92945b79a1e0055ccdffb0e P 53325eef37064d61b4c1e6ff915cd94c: Deleting consensus metadata
I20260809 03:23:26.410152 10635 tablet_bootstrap.cc:492] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1: Bootstrap starting.
I20260809 03:23:26.410156 10637 tablet_bootstrap.cc:492] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c: Bootstrap starting.
I20260809 03:23:26.410565 10635 tablet_bootstrap.cc:654] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:26.410574 10637 tablet_bootstrap.cc:654] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:26.410753 10686 tablet_replica.cc:330] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8: stopping tablet replica
I20260809 03:23:26.410936 10686 raft_consensus.cc:2229] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:26.411078 10067 catalog_manager.cc:4841] TS 53325eef37064d61b4c1e6ff915cd94c (127.8.5.193:40363): tablet 8871b756d92945b79a1e0055ccdffb0e (table test-table [id=bf41fbcdfd944f2e880f3577a87a39a9]) successfully deleted
I20260809 03:23:26.411250 10637 tablet_bootstrap.cc:492] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c: No bootstrap required, opened a new log
I20260809 03:23:26.411301 10637 ts_tablet_manager.cc:1397] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:26.411432 10637 raft_consensus.cc:348] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.411453 10536 tablet_service.cc:1467] Processing CreateTablet for tablet 07f9e473b41b4a519908a25366e9d10e (DEFAULT_TABLE table=test-table [id=dbc7589f027d46e98c88e5b9999cc94d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:26.411489 10637 raft_consensus.cc:374] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:26.411506 10637 raft_consensus.cc:729] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53325eef37064d61b4c1e6ff915cd94c, State: Initialized, Role: FOLLOWER
I20260809 03:23:26.411540 10637 consensus_queue.cc:260] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.411564 10536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07f9e473b41b4a519908a25366e9d10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:26.411607 10637 ts_tablet_manager.cc:1428] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:26.412086 10635 tablet_bootstrap.cc:492] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1: No bootstrap required, opened a new log
I20260809 03:23:26.412124 10635 ts_tablet_manager.cc:1397] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:23:26.412271 10635 raft_consensus.cc:348] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.412325 10635 raft_consensus.cc:374] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:26.412344 10635 raft_consensus.cc:729] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a3830c836da4a20aa915f9463be93a1, State: Initialized, Role: FOLLOWER
I20260809 03:23:26.412388 10635 consensus_queue.cc:260] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.412472 10635 ts_tablet_manager.cc:1428] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:26.412902 10636 tablet_bootstrap.cc:492] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8: Bootstrap starting.
I20260809 03:23:26.413129 10686 raft_consensus.cc:2258] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:26.415107 10685 tablet_replica.cc:330] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1: stopping tablet replica
I20260809 03:23:26.415216 10685 raft_consensus.cc:2229] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:23:26.415346 10685 raft_consensus.cc:2258] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:26.415822 10685 ts_tablet_manager.cc:1905] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:26.417464 10685 ts_tablet_manager.cc:1918] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 03:23:26.417538 10685 log.cc:1196] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/8871b756d92945b79a1e0055ccdffb0e
I20260809 03:23:26.417800 10685 ts_tablet_manager.cc:1939] T 8871b756d92945b79a1e0055ccdffb0e P 6a3830c836da4a20aa915f9463be93a1: Deleting consensus metadata
I20260809 03:23:26.418299 10067 catalog_manager.cc:4841] TS 6a3830c836da4a20aa915f9463be93a1 (127.8.5.194:35513): tablet 8871b756d92945b79a1e0055ccdffb0e (table test-table [id=bf41fbcdfd944f2e880f3577a87a39a9]) successfully deleted
I20260809 03:23:26.413329 10636 tablet_bootstrap.cc:654] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:26.423411 10686 ts_tablet_manager.cc:1905] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:26.423731 10636 tablet_bootstrap.cc:492] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8: No bootstrap required, opened a new log
I20260809 03:23:26.423777 10636 ts_tablet_manager.cc:1397] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20260809 03:23:26.423914 10636 raft_consensus.cc:348] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.423980 10636 raft_consensus.cc:374] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:26.423997 10636 raft_consensus.cc:729] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f20941487a4384b197f36334175ce8, State: Initialized, Role: FOLLOWER
I20260809 03:23:26.424041 10636 consensus_queue.cc:260] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.424113 10636 ts_tablet_manager.cc:1428] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:26.425005 10686 ts_tablet_manager.cc:1918] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 03:23:26.425063 10686 log.cc:1196] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/8871b756d92945b79a1e0055ccdffb0e
I20260809 03:23:26.425311 10686 ts_tablet_manager.cc:1939] T 8871b756d92945b79a1e0055ccdffb0e P e5f20941487a4384b197f36334175ce8: Deleting consensus metadata
I20260809 03:23:26.425735 10065 catalog_manager.cc:4841] TS e5f20941487a4384b197f36334175ce8 (127.8.5.195:45617): tablet 8871b756d92945b79a1e0055ccdffb0e (table test-table [id=bf41fbcdfd944f2e880f3577a87a39a9]) successfully deleted
I20260809 03:23:26.575160 10643 raft_consensus.cc:482] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:23:26.575264 10643 raft_consensus.cc:504] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.575650 10643 leader_election.cc:288] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a3830c836da4a20aa915f9463be93a1 (127.8.5.194:35513), e5f20941487a4384b197f36334175ce8 (127.8.5.195:45617)
I20260809 03:23:26.578754 10631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.576056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:53193 (local address 127.8.5.194:35513)
0809 03:23:26.576107 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.576109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.576218 (+ 109us) server_negotiation.cc:407] Connection header received
0809 03:23:26.576270 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.576270 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.576280 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.576340 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:26.576539 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.577019 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.578007 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.578389 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.578443 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.578451 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.578639 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.578679 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 03:23:26.578855 10632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.575960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:57095 (local address 127.8.5.195:45617)
0809 03:23:26.576028 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.576030 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.576100 (+ 70us) server_negotiation.cc:407] Connection header received
0809 03:23:26.576185 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.576187 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.576199 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.576254 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:26.576445 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.576959 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.578084 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.578477 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.578549 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.578558 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.578736 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.578783 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 03:23:26.578917 10691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.575863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:45617 (local address 127.8.5.193:57095)
0809 03:23:26.576008 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:26.576021 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:26.576097 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:26.576275 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:26.576276 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:26.576279 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:26.576346 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.576348 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.577052 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.577053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.577990 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.577993 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.578562 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.578563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.578651 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.578655 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:23:26.578713 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 03:23:26.578753 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":1,"thread_start_us":101,"threads_started":1}
I20260809 03:23:26.578771 10692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.575863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:35513 (local address 127.8.5.193:53193)
0809 03:23:26.576130 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:26.576142 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:26.576208 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:26.576365 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:26.576365 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:26.576367 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:26.576465 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.576467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.577121 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.577122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.577909 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.577911 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.578478 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.578479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.578558 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.578564 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 03:23:26.578617 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 03:23:26.578655 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"mutex_wait_us":32,"thread_start_us":62,"threads_started":1}
I20260809 03:23:26.579245 10558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07f9e473b41b4a519908a25366e9d10e" candidate_uuid: "53325eef37064d61b4c1e6ff915cd94c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f20941487a4384b197f36334175ce8" is_pre_election: true
I20260809 03:23:26.579263 10404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07f9e473b41b4a519908a25366e9d10e" candidate_uuid: "53325eef37064d61b4c1e6ff915cd94c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a3830c836da4a20aa915f9463be93a1" is_pre_election: true
I20260809 03:23:26.579361 10558 raft_consensus.cc:2454] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53325eef37064d61b4c1e6ff915cd94c in term 0.
I20260809 03:23:26.579360 10404 raft_consensus.cc:2454] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53325eef37064d61b4c1e6ff915cd94c in term 0.
I20260809 03:23:26.579533 10181 leader_election.cc:302] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53325eef37064d61b4c1e6ff915cd94c, 6a3830c836da4a20aa915f9463be93a1; no voters:
I20260809 03:23:26.579686 10643 raft_consensus.cc:2781] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:23:26.579756 10643 raft_consensus.cc:482] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:23:26.579783 10643 raft_consensus.cc:3037] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:26.580466 10643 raft_consensus.cc:504] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.580613 10643 leader_election.cc:288] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [CANDIDATE]: Term 1 election: Requested vote from peers 6a3830c836da4a20aa915f9463be93a1 (127.8.5.194:35513), e5f20941487a4384b197f36334175ce8 (127.8.5.195:45617)
I20260809 03:23:26.580749 10404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07f9e473b41b4a519908a25366e9d10e" candidate_uuid: "53325eef37064d61b4c1e6ff915cd94c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a3830c836da4a20aa915f9463be93a1"
I20260809 03:23:26.580818 10404 raft_consensus.cc:3037] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:26.580755 10558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07f9e473b41b4a519908a25366e9d10e" candidate_uuid: "53325eef37064d61b4c1e6ff915cd94c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f20941487a4384b197f36334175ce8"
I20260809 03:23:26.580861 10558 raft_consensus.cc:3037] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:26.581440 10558 raft_consensus.cc:2454] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53325eef37064d61b4c1e6ff915cd94c in term 1.
I20260809 03:23:26.581459 10404 raft_consensus.cc:2454] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53325eef37064d61b4c1e6ff915cd94c in term 1.
I20260809 03:23:26.581616 10181 leader_election.cc:302] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53325eef37064d61b4c1e6ff915cd94c, 6a3830c836da4a20aa915f9463be93a1; no voters:
I20260809 03:23:26.581719 10643 raft_consensus.cc:2781] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:26.581861 10643 raft_consensus.cc:686] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [term 1 LEADER]: Becoming Leader. State: Replica: 53325eef37064d61b4c1e6ff915cd94c, State: Running, Role: LEADER
I20260809 03:23:26.581923 10643 consensus_queue.cc:237] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:26.582720 10081 catalog_manager.cc:5495] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c reported cstate change: term changed from 0 to 1, leader changed from <none> to 53325eef37064d61b4c1e6ff915cd94c (127.8.5.193). New cstate: current_term: 1 leader_uuid: "53325eef37064d61b4c1e6ff915cd94c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260809 03:23:26.598500 10634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.596257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46170 (local address 127.8.5.193:40363)
0809 03:23:26.596299 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.596301 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.596326 (+ 25us) server_negotiation.cc:407] Connection header received
0809 03:23:26.596399 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.596399 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.596439 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.596511 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:26.596653 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.597149 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.597864 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.598032 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.598080 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.598202 (+ 122us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:26.598299 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:26.598349 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.598382 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.598397 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:23:26.603215 10632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.600887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:39237 (local address 127.8.5.195:45617)
0809 03:23:26.600930 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.600931 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.601060 (+ 129us) server_negotiation.cc:407] Connection header received
0809 03:23:26.601097 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.601098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.601110 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.601156 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:26.601326 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.601763 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.602532 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.602710 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.602771 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.602946 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:26.603023 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:26.603073 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.603143 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.603162 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:23:26.603233 10697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.600821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:45617 (local address 127.8.5.193:39237)
0809 03:23:26.600995 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:26.601004 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:26.601056 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:26.601184 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:26.601185 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:26.601187 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 03:23:26.601250 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.601255 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.601836 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.601837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.602459 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.602461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.602802 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.602803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.602858 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.602872 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 03:23:26.603089 (+ 217us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 03:23:26.603091 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:23:26.603130 (+ 39us) client_negotiation.cc:240] Negotiation successful
0809 03:23:26.603164 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":83,"threads_started":1}
I20260809 03:23:26.605382 10404 raft_consensus.cc:1261] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1 [term 1 FOLLOWER]: Refusing update from remote peer 53325eef37064d61b4c1e6ff915cd94c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:26.605381 10558 raft_consensus.cc:1261] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8 [term 1 FOLLOWER]: Refusing update from remote peer 53325eef37064d61b4c1e6ff915cd94c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:26.605636 10693 consensus_queue.cc:1035] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:26.605746 10643 consensus_queue.cc:1035] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:26.612589 10634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.610334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:58107 (local address 127.8.5.193:40363)
0809 03:23:26.610380 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:26.610382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:26.610389 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:23:26.610408 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:26.610409 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:26.610417 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:26.610470 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:26.610578 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.611213 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.611884 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.612055 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.612103 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.612313 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:26.612369 (+ 56us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:26.612422 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:26.612493 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 03:23:26.612516 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 03:23:26.612609 10615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:26.610255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:40363 (local address 127.8.5.195:58107)
0809 03:23:26.610298 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:26.610310 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:26.610350 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:26.610477 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:26.610478 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:26.610479 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 03:23:26.610511 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.610512 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.611280 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.611281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.611797 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:26.611798 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:26.612177 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:26.612178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:26.612240 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:26.612244 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 03:23:26.612434 (+ 190us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 03:23:26.612436 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:23:26.612478 (+ 42us) client_negotiation.cc:240] Negotiation successful
0809 03:23:26.612527 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
W20260809 03:23:26.612881 10668 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 03:23:28.132059 10081 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33670:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:28.132160 10081 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33670:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:28.133044 10081 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc: Sending DeleteTablet for 3 replicas of tablet 07f9e473b41b4a519908a25366e9d10e
I20260809 03:23:28.133291 10233 tablet_service.cc:1514] Processing DeleteTablet for tablet 07f9e473b41b4a519908a25366e9d10e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:28 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:46160
I20260809 03:23:28.133376 10536 tablet_service.cc:1514] Processing DeleteTablet for tablet 07f9e473b41b4a519908a25366e9d10e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:28 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:48784
I20260809 03:23:28.133491 10382 tablet_service.cc:1514] Processing DeleteTablet for tablet 07f9e473b41b4a519908a25366e9d10e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:28 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:45300
I20260809 03:23:28.133677 10732 tablet_replica.cc:330] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1: stopping tablet replica
I20260809 03:23:28.133684 10730 tablet_replica.cc:330] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c: stopping tablet replica
I20260809 03:23:28.133736 10730 raft_consensus.cc:2229] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:23:28.133736 10732 raft_consensus.cc:2229] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:28.133771 10732 raft_consensus.cc:2258] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:28.133821 10730 raft_consensus.cc:2258] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:28.133922 10731 tablet_replica.cc:330] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8: stopping tablet replica
I20260809 03:23:28.133982 10731 raft_consensus.cc:2229] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:28.134020 10731 raft_consensus.cc:2258] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:28.134033 10732 ts_tablet_manager.cc:1905] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:28.134240 10731 ts_tablet_manager.cc:1905] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:28.135996 10730 ts_tablet_manager.cc:1905] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:28.136142 10732 ts_tablet_manager.cc:1918] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 03:23:28.136205 10732 log.cc:1196] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/07f9e473b41b4a519908a25366e9d10e
I20260809 03:23:28.136425 10732 ts_tablet_manager.cc:1939] T 07f9e473b41b4a519908a25366e9d10e P 6a3830c836da4a20aa915f9463be93a1: Deleting consensus metadata
I20260809 03:23:28.136732 10067 catalog_manager.cc:4841] TS 6a3830c836da4a20aa915f9463be93a1 (127.8.5.194:35513): tablet 07f9e473b41b4a519908a25366e9d10e (table test-table [id=dbc7589f027d46e98c88e5b9999cc94d]) successfully deleted
I20260809 03:23:28.137468 10730 ts_tablet_manager.cc:1918] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 03:23:28.137517 10730 log.cc:1196] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/wal/wals/07f9e473b41b4a519908a25366e9d10e
I20260809 03:23:28.137758 10730 ts_tablet_manager.cc:1939] T 07f9e473b41b4a519908a25366e9d10e P 53325eef37064d61b4c1e6ff915cd94c: Deleting consensus metadata
I20260809 03:23:28.138077 10067 catalog_manager.cc:4841] TS 53325eef37064d61b4c1e6ff915cd94c (127.8.5.193:40363): tablet 07f9e473b41b4a519908a25366e9d10e (table test-table [id=dbc7589f027d46e98c88e5b9999cc94d]) successfully deleted
I20260809 03:23:28.139089 10731 ts_tablet_manager.cc:1918] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 03:23:28.139160 10731 log.cc:1196] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/07f9e473b41b4a519908a25366e9d10e
I20260809 03:23:28.139380 10731 ts_tablet_manager.cc:1939] T 07f9e473b41b4a519908a25366e9d10e P e5f20941487a4384b197f36334175ce8: Deleting consensus metadata
I20260809 03:23:28.139681 10065 catalog_manager.cc:4841] TS e5f20941487a4384b197f36334175ce8 (127.8.5.195:45617): tablet 07f9e473b41b4a519908a25366e9d10e (table test-table [id=dbc7589f027d46e98c88e5b9999cc94d]) successfully deleted
Aug 09 03:23:28 dist-test-slave-2w3w krb5kdc[10034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245808, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 03:23:28 dist-test-slave-2w3w krb5kdc[10034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245808, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:28.160386 10742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:28.150454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33684 (local address 127.8.5.254:38563)
0809 03:23:28.150591 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:28.150593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:28.150602 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:23:28.150622 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:28.150623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:28.150633 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:28.150694 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:28.151274 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:28.151772 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:28.152521 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:28.152707 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:28.152757 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:28.157905 (+ 5148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:28.157907 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:28.157907 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:28.157913 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:28.159448 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:28.159738 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:28.159739 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:28.159739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:28.159790 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:28.159944 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:28.159945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:28.159945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:28.160044 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:28.160118 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:28.160203 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 03:23:28.160264 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":84,"threads_started":1}
I20260809 03:23:28.161763 10081 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33684:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:23:28.161908 10081 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:23:28.163213 10233 tablet_service.cc:1467] Processing CreateTablet for tablet 3e1a758d57764965813fdf2d0e7c0d00 (DEFAULT_TABLE table=test-table [id=c8066824a0264e6786e395e88bd725ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:28.163254 10536 tablet_service.cc:1467] Processing CreateTablet for tablet 3e1a758d57764965813fdf2d0e7c0d00 (DEFAULT_TABLE table=test-table [id=c8066824a0264e6786e395e88bd725ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:28.163336 10233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e1a758d57764965813fdf2d0e7c0d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:28.163373 10536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e1a758d57764965813fdf2d0e7c0d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:28.164259 10743 tablet_bootstrap.cc:492] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c: Bootstrap starting.
I20260809 03:23:28.164321 10382 tablet_service.cc:1467] Processing CreateTablet for tablet 3e1a758d57764965813fdf2d0e7c0d00 (DEFAULT_TABLE table=test-table [id=c8066824a0264e6786e395e88bd725ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:28.164459 10382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e1a758d57764965813fdf2d0e7c0d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:28.164654 10743 tablet_bootstrap.cc:654] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:28.164999 10744 tablet_bootstrap.cc:492] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8: Bootstrap starting.
I20260809 03:23:28.165370 10744 tablet_bootstrap.cc:654] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:28.166019 10744 tablet_bootstrap.cc:492] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8: No bootstrap required, opened a new log
I20260809 03:23:28.166074 10744 ts_tablet_manager.cc:1397] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:28.166239 10744 raft_consensus.cc:348] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:28.166261 10743 tablet_bootstrap.cc:492] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c: No bootstrap required, opened a new log
I20260809 03:23:28.166324 10744 raft_consensus.cc:374] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:28.166352 10743 ts_tablet_manager.cc:1397] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:23:28.166379 10744 raft_consensus.cc:729] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f20941487a4384b197f36334175ce8, State: Initialized, Role: FOLLOWER
I20260809 03:23:28.166429 10744 consensus_queue.cc:260] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:28.166455 10743 raft_consensus.cc:348] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:28.166527 10743 raft_consensus.cc:374] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:28.166535 10744 ts_tablet_manager.cc:1428] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:28.166563 10743 raft_consensus.cc:729] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53325eef37064d61b4c1e6ff915cd94c, State: Initialized, Role: FOLLOWER
I20260809 03:23:28.166610 10743 consensus_queue.cc:260] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:28.166631 10748 tablet_bootstrap.cc:492] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1: Bootstrap starting.
I20260809 03:23:28.166715 10743 ts_tablet_manager.cc:1428] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:28.167153 10748 tablet_bootstrap.cc:654] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:28.167809 10748 tablet_bootstrap.cc:492] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1: No bootstrap required, opened a new log
I20260809 03:23:28.167878 10748 ts_tablet_manager.cc:1397] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 03:23:28.168013 10748 raft_consensus.cc:348] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:28.168084 10748 raft_consensus.cc:374] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:28.168107 10748 raft_consensus.cc:729] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a3830c836da4a20aa915f9463be93a1, State: Initialized, Role: FOLLOWER
I20260809 03:23:28.168161 10748 consensus_queue.cc:260] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:28.168319 10748 ts_tablet_manager.cc:1428] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 03:23:28.256682 10718 raft_consensus.cc:482] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:23:28.256780 10718 raft_consensus.cc:504] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:28.257107 10718 leader_election.cc:288] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a3830c836da4a20aa915f9463be93a1 (127.8.5.194:35513), e5f20941487a4384b197f36334175ce8 (127.8.5.195:45617)
I20260809 03:23:28.257296 10403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e1a758d57764965813fdf2d0e7c0d00" candidate_uuid: "53325eef37064d61b4c1e6ff915cd94c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a3830c836da4a20aa915f9463be93a1" is_pre_election: true
I20260809 03:23:28.257341 10558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e1a758d57764965813fdf2d0e7c0d00" candidate_uuid: "53325eef37064d61b4c1e6ff915cd94c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f20941487a4384b197f36334175ce8" is_pre_election: true
I20260809 03:23:28.257444 10403 raft_consensus.cc:2454] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53325eef37064d61b4c1e6ff915cd94c in term 0.
I20260809 03:23:28.257458 10558 raft_consensus.cc:2454] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53325eef37064d61b4c1e6ff915cd94c in term 0.
I20260809 03:23:28.257611 10181 leader_election.cc:302] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53325eef37064d61b4c1e6ff915cd94c, 6a3830c836da4a20aa915f9463be93a1; no voters:
I20260809 03:23:28.257720 10718 raft_consensus.cc:2781] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:23:28.257795 10718 raft_consensus.cc:482] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:23:28.257825 10718 raft_consensus.cc:3037] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:28.258630 10718 raft_consensus.cc:504] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:28.258805 10718 leader_election.cc:288] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [CANDIDATE]: Term 1 election: Requested vote from peers 6a3830c836da4a20aa915f9463be93a1 (127.8.5.194:35513), e5f20941487a4384b197f36334175ce8 (127.8.5.195:45617)
I20260809 03:23:28.258998 10403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e1a758d57764965813fdf2d0e7c0d00" candidate_uuid: "53325eef37064d61b4c1e6ff915cd94c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a3830c836da4a20aa915f9463be93a1"
I20260809 03:23:28.259070 10403 raft_consensus.cc:3037] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:28.259022 10558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e1a758d57764965813fdf2d0e7c0d00" candidate_uuid: "53325eef37064d61b4c1e6ff915cd94c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f20941487a4384b197f36334175ce8"
I20260809 03:23:28.259112 10558 raft_consensus.cc:3037] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:28.259749 10403 raft_consensus.cc:2454] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53325eef37064d61b4c1e6ff915cd94c in term 1.
I20260809 03:23:28.259879 10558 raft_consensus.cc:2454] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53325eef37064d61b4c1e6ff915cd94c in term 1.
I20260809 03:23:28.259917 10181 leader_election.cc:302] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53325eef37064d61b4c1e6ff915cd94c, 6a3830c836da4a20aa915f9463be93a1; no voters:
I20260809 03:23:28.260087 10718 raft_consensus.cc:2781] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:28.260180 10718 raft_consensus.cc:686] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [term 1 LEADER]: Becoming Leader. State: Replica: 53325eef37064d61b4c1e6ff915cd94c, State: Running, Role: LEADER
I20260809 03:23:28.260236 10718 consensus_queue.cc:237] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:28.260819 10081 catalog_manager.cc:5495] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c reported cstate change: term changed from 0 to 1, leader changed from <none> to 53325eef37064d61b4c1e6ff915cd94c (127.8.5.193). New cstate: current_term: 1 leader_uuid: "53325eef37064d61b4c1e6ff915cd94c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260809 03:23:28.286437 10753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:28.284047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46180 (local address 127.8.5.193:40363)
0809 03:23:28.284197 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:28.284198 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:28.284204 (+ 6us) server_negotiation.cc:407] Connection header received
0809 03:23:28.284221 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:28.284222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:28.284232 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:28.284313 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:28.284447 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:28.284962 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:28.285728 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:28.285947 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:28.286021 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:28.286171 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:28.286204 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:28.286263 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:28.286335 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 03:23:28.286356 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":79,"threads_started":1}
I20260809 03:23:28.288415 10558 raft_consensus.cc:1261] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8 [term 1 FOLLOWER]: Refusing update from remote peer 53325eef37064d61b4c1e6ff915cd94c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:28.288445 10403 raft_consensus.cc:1261] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1 [term 1 FOLLOWER]: Refusing update from remote peer 53325eef37064d61b4c1e6ff915cd94c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:28.288661 10718 consensus_queue.cc:1035] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:28.288756 10704 consensus_queue.cc:1035] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:28.298269 10082 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:28.298359 10082 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:28.298924 10082 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc: Sending DeleteTablet for 3 replicas of tablet 3e1a758d57764965813fdf2d0e7c0d00
I20260809 03:23:28.299156 10233 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e1a758d57764965813fdf2d0e7c0d00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:28 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:46160
I20260809 03:23:28.299253 10382 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e1a758d57764965813fdf2d0e7c0d00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:28 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:45300
I20260809 03:23:28.299355 10730 tablet_replica.cc:330] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c: stopping tablet replica
I20260809 03:23:28.299350 10732 tablet_replica.cc:330] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1: stopping tablet replica
I20260809 03:23:28.299413 10730 raft_consensus.cc:2229] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:23:28.299417 10732 raft_consensus.cc:2229] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:28.299458 10732 raft_consensus.cc:2258] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:28.299471 10730 raft_consensus.cc:2258] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:28.299714 10536 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e1a758d57764965813fdf2d0e7c0d00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:28 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:48784
I20260809 03:23:28.299751 10732 ts_tablet_manager.cc:1905] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:28.299803 10731 tablet_replica.cc:330] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8: stopping tablet replica
I20260809 03:23:28.299857 10731 raft_consensus.cc:2229] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:28.299907 10731 raft_consensus.cc:2258] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:28.300169 10731 ts_tablet_manager.cc:1905] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:28.300169 10730 ts_tablet_manager.cc:1905] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:28.301530 10732 ts_tablet_manager.cc:1918] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 03:23:28.301610 10732 log.cc:1196] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/3e1a758d57764965813fdf2d0e7c0d00
I20260809 03:23:28.301678 10731 ts_tablet_manager.cc:1918] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 03:23:28.301748 10731 log.cc:1196] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/3e1a758d57764965813fdf2d0e7c0d00
I20260809 03:23:28.301692 10082 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33684:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:23:28.301836 10082 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:23:28.301892 10732 ts_tablet_manager.cc:1939] T 3e1a758d57764965813fdf2d0e7c0d00 P 6a3830c836da4a20aa915f9463be93a1: Deleting consensus metadata
I20260809 03:23:28.301990 10731 ts_tablet_manager.cc:1939] T 3e1a758d57764965813fdf2d0e7c0d00 P e5f20941487a4384b197f36334175ce8: Deleting consensus metadata
I20260809 03:23:28.302232 10730 ts_tablet_manager.cc:1918] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 03:23:28.302222 10067 catalog_manager.cc:4841] TS 6a3830c836da4a20aa915f9463be93a1 (127.8.5.194:35513): tablet 3e1a758d57764965813fdf2d0e7c0d00 (table test-table [id=c8066824a0264e6786e395e88bd725ca]) successfully deleted
I20260809 03:23:28.302294 10730 log.cc:1196] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-0/wal/wals/3e1a758d57764965813fdf2d0e7c0d00
I20260809 03:23:28.302548 10730 ts_tablet_manager.cc:1939] T 3e1a758d57764965813fdf2d0e7c0d00 P 53325eef37064d61b4c1e6ff915cd94c: Deleting consensus metadata
I20260809 03:23:28.302605 10065 catalog_manager.cc:4841] TS e5f20941487a4384b197f36334175ce8 (127.8.5.195:45617): tablet 3e1a758d57764965813fdf2d0e7c0d00 (table test-table [id=c8066824a0264e6786e395e88bd725ca]) successfully deleted
I20260809 03:23:28.302872 10067 catalog_manager.cc:4841] TS 53325eef37064d61b4c1e6ff915cd94c (127.8.5.193:40363): tablet 3e1a758d57764965813fdf2d0e7c0d00 (table test-table [id=c8066824a0264e6786e395e88bd725ca]) successfully deleted
I20260809 03:23:28.303645 10382 tablet_service.cc:1467] Processing CreateTablet for tablet be3990f7ed66466caa2fb52d939ec5c9 (DEFAULT_TABLE table=test-table [id=fafb08e588dd4a4c9e0b1ab8155e4ff5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:28.303679 10233 tablet_service.cc:1467] Processing CreateTablet for tablet be3990f7ed66466caa2fb52d939ec5c9 (DEFAULT_TABLE table=test-table [id=fafb08e588dd4a4c9e0b1ab8155e4ff5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:28.303768 10382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be3990f7ed66466caa2fb52d939ec5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:28.303781 10233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be3990f7ed66466caa2fb52d939ec5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:28.304592 10748 tablet_bootstrap.cc:492] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1: Bootstrap starting.
I20260809 03:23:28.304687 10743 tablet_bootstrap.cc:492] T be3990f7ed66466caa2fb52d939ec5c9 P 53325eef37064d61b4c1e6ff915cd94c: Bootstrap starting.
I20260809 03:23:28.304730 10536 tablet_service.cc:1467] Processing CreateTablet for tablet be3990f7ed66466caa2fb52d939ec5c9 (DEFAULT_TABLE table=test-table [id=fafb08e588dd4a4c9e0b1ab8155e4ff5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:28.304839 10536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be3990f7ed66466caa2fb52d939ec5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:28.304906 10748 tablet_bootstrap.cc:654] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:28.305012 10743 tablet_bootstrap.cc:654] T be3990f7ed66466caa2fb52d939ec5c9 P 53325eef37064d61b4c1e6ff915cd94c: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:28.305465 10748 tablet_bootstrap.cc:492] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1: No bootstrap required, opened a new log
I20260809 03:23:28.305507 10748 ts_tablet_manager.cc:1397] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 03:23:28.305588 10748 raft_consensus.cc:348] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:28.305637 10748 raft_consensus.cc:374] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:28.305650 10748 raft_consensus.cc:729] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a3830c836da4a20aa915f9463be93a1, State: Initialized, Role: FOLLOWER
I20260809 03:23:28.305681 10748 consensus_queue.cc:260] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:28.305780 10748 ts_tablet_manager.cc:1428] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:28.306130 10743 tablet_bootstrap.cc:492] T be3990f7ed66466caa2fb52d939ec5c9 P 53325eef37064d61b4c1e6ff915cd94c: No bootstrap required, opened a new log
I20260809 03:23:28.306147 10744 tablet_bootstrap.cc:492] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8: Bootstrap starting.
I20260809 03:23:28.306181 10743 ts_tablet_manager.cc:1397] T be3990f7ed66466caa2fb52d939ec5c9 P 53325eef37064d61b4c1e6ff915cd94c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:23:28.306281 10743 raft_consensus.cc:348] T be3990f7ed66466caa2fb52d939ec5c9 P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:28.306347 10743 raft_consensus.cc:374] T be3990f7ed66466caa2fb52d939ec5c9 P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:28.306373 10743 raft_consensus.cc:729] T be3990f7ed66466caa2fb52d939ec5c9 P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53325eef37064d61b4c1e6ff915cd94c, State: Initialized, Role: FOLLOWER
I20260809 03:23:28.306418 10743 consensus_queue.cc:260] T be3990f7ed66466caa2fb52d939ec5c9 P 53325eef37064d61b4c1e6ff915cd94c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:28.306469 10744 tablet_bootstrap.cc:654] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:28.306530 10743 ts_tablet_manager.cc:1428] T be3990f7ed66466caa2fb52d939ec5c9 P 53325eef37064d61b4c1e6ff915cd94c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:28.307256 10744 tablet_bootstrap.cc:492] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8: No bootstrap required, opened a new log
I20260809 03:23:28.307325 10744 ts_tablet_manager.cc:1397] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:28.307427 10744 raft_consensus.cc:348] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:28.307485 10744 raft_consensus.cc:374] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:28.307499 10744 raft_consensus.cc:729] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f20941487a4384b197f36334175ce8, State: Initialized, Role: FOLLOWER
I20260809 03:23:28.307550 10744 consensus_queue.cc:260] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:28.307652 10744 ts_tablet_manager.cc:1428] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260809 03:23:28.416548 10609 tablet.cc:2369] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:23:28.517376 10750 raft_consensus.cc:482] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:23:28.517473 10750 raft_consensus.cc:504] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:28.517668 10750 leader_election.cc:288] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53325eef37064d61b4c1e6ff915cd94c (127.8.5.193:40363), e5f20941487a4384b197f36334175ce8 (127.8.5.195:45617)
I20260809 03:23:28.517892 10256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be3990f7ed66466caa2fb52d939ec5c9" candidate_uuid: "6a3830c836da4a20aa915f9463be93a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53325eef37064d61b4c1e6ff915cd94c" is_pre_election: true
I20260809 03:23:28.517896 10558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be3990f7ed66466caa2fb52d939ec5c9" candidate_uuid: "6a3830c836da4a20aa915f9463be93a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f20941487a4384b197f36334175ce8" is_pre_election: true
I20260809 03:23:28.517999 10558 raft_consensus.cc:2454] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a3830c836da4a20aa915f9463be93a1 in term 0.
I20260809 03:23:28.518013 10256 raft_consensus.cc:2454] T be3990f7ed66466caa2fb52d939ec5c9 P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a3830c836da4a20aa915f9463be93a1 in term 0.
I20260809 03:23:28.518159 10329 leader_election.cc:302] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a3830c836da4a20aa915f9463be93a1, e5f20941487a4384b197f36334175ce8; no voters:
I20260809 03:23:28.518298 10750 raft_consensus.cc:2781] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:23:28.518363 10750 raft_consensus.cc:482] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:23:28.518380 10750 raft_consensus.cc:3037] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:28.519155 10750 raft_consensus.cc:504] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:28.519292 10750 leader_election.cc:288] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [CANDIDATE]: Term 1 election: Requested vote from peers 53325eef37064d61b4c1e6ff915cd94c (127.8.5.193:40363), e5f20941487a4384b197f36334175ce8 (127.8.5.195:45617)
I20260809 03:23:28.519485 10558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be3990f7ed66466caa2fb52d939ec5c9" candidate_uuid: "6a3830c836da4a20aa915f9463be93a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f20941487a4384b197f36334175ce8"
I20260809 03:23:28.519500 10256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be3990f7ed66466caa2fb52d939ec5c9" candidate_uuid: "6a3830c836da4a20aa915f9463be93a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53325eef37064d61b4c1e6ff915cd94c"
I20260809 03:23:28.519562 10558 raft_consensus.cc:3037] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:28.519578 10256 raft_consensus.cc:3037] T be3990f7ed66466caa2fb52d939ec5c9 P 53325eef37064d61b4c1e6ff915cd94c [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:28.520171 10558 raft_consensus.cc:2454] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a3830c836da4a20aa915f9463be93a1 in term 1.
I20260809 03:23:28.520315 10256 raft_consensus.cc:2454] T be3990f7ed66466caa2fb52d939ec5c9 P 53325eef37064d61b4c1e6ff915cd94c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a3830c836da4a20aa915f9463be93a1 in term 1.
I20260809 03:23:28.520361 10329 leader_election.cc:302] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a3830c836da4a20aa915f9463be93a1, e5f20941487a4384b197f36334175ce8; no voters:
I20260809 03:23:28.520440 10750 raft_consensus.cc:2781] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:28.520567 10750 raft_consensus.cc:686] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [term 1 LEADER]: Becoming Leader. State: Replica: 6a3830c836da4a20aa915f9463be93a1, State: Running, Role: LEADER
I20260809 03:23:28.520653 10750 consensus_queue.cc:237] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } }
I20260809 03:23:28.521445 10082 catalog_manager.cc:5495] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a3830c836da4a20aa915f9463be93a1 (127.8.5.194). New cstate: current_term: 1 leader_uuid: "6a3830c836da4a20aa915f9463be93a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a3830c836da4a20aa915f9463be93a1" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 35513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260809 03:23:28.536768 10763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:28.534288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43638 (local address 127.8.5.194:35513)
0809 03:23:28.534459 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:28.534460 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:28.534467 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:23:28.534489 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:28.534490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:28.534501 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:28.534576 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:28.534685 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:28.535284 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:28.536009 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:28.536230 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:28.536305 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:28.536465 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:28.536507 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:28.536569 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:28.536641 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 03:23:28.536662 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":94,"threads_started":1}
I20260809 03:23:28.539088 10558 raft_consensus.cc:1261] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8 [term 1 FOLLOWER]: Refusing update from remote peer 6a3830c836da4a20aa915f9463be93a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:28.539098 10256 raft_consensus.cc:1261] T be3990f7ed66466caa2fb52d939ec5c9 P 53325eef37064d61b4c1e6ff915cd94c [term 1 FOLLOWER]: Refusing update from remote peer 6a3830c836da4a20aa915f9463be93a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:28.539304 10750 consensus_queue.cc:1035] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f20941487a4384b197f36334175ce8" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:28.539521 10750 consensus_queue.cc:1035] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53325eef37064d61b4c1e6ff915cd94c" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 40363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 03:23:28.543763 10708 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 03:23:30.061581 10082 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:30.061678 10082 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:30.062526 10082 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a55d9304a6474134a03a024cc5cab8cc: Sending DeleteTablet for 3 replicas of tablet be3990f7ed66466caa2fb52d939ec5c9
I20260809 03:23:30.062813 10536 tablet_service.cc:1514] Processing DeleteTablet for tablet be3990f7ed66466caa2fb52d939ec5c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:30 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:48784
I20260809 03:23:30.062839 10382 tablet_service.cc:1514] Processing DeleteTablet for tablet be3990f7ed66466caa2fb52d939ec5c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:30 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:45300
I20260809 03:23:30.062847 10233 tablet_service.cc:1514] Processing DeleteTablet for tablet be3990f7ed66466caa2fb52d939ec5c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:30 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:46160
I20260809 03:23:30.063015 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 10161
I20260809 03:23:30.063077 10790 tablet_replica.cc:330] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8: stopping tablet replica
I20260809 03:23:30.064189 10790 raft_consensus.cc:2229] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:30.064229 10790 raft_consensus.cc:2258] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:30.064355 10789 tablet_replica.cc:330] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1: stopping tablet replica
I20260809 03:23:30.064435 10789 raft_consensus.cc:2229] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:23:30.064498 10789 raft_consensus.cc:2258] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:30.064731 10790 ts_tablet_manager.cc:1905] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:30.067118 10790 ts_tablet_manager.cc:1918] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 03:23:30.067106 10789 ts_tablet_manager.cc:1905] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:30.067198 10790 log.cc:1196] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/be3990f7ed66466caa2fb52d939ec5c9
I20260809 03:23:30.067406 10790 ts_tablet_manager.cc:1939] T be3990f7ed66466caa2fb52d939ec5c9 P e5f20941487a4384b197f36334175ce8: Deleting consensus metadata
I20260809 03:23:30.067696 10065 catalog_manager.cc:4841] TS e5f20941487a4384b197f36334175ce8 (127.8.5.195:45617): tablet be3990f7ed66466caa2fb52d939ec5c9 (table test-table [id=fafb08e588dd4a4c9e0b1ab8155e4ff5]) successfully deleted
I20260809 03:23:30.069428 10789 ts_tablet_manager.cc:1918] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 03:23:30.069491 10789 log.cc:1196] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/be3990f7ed66466caa2fb52d939ec5c9
I20260809 03:23:30.069756 10789 ts_tablet_manager.cc:1939] T be3990f7ed66466caa2fb52d939ec5c9 P 6a3830c836da4a20aa915f9463be93a1: Deleting consensus metadata
I20260809 03:23:30.075248 10067 catalog_manager.cc:4841] TS 6a3830c836da4a20aa915f9463be93a1 (127.8.5.194:35513): tablet be3990f7ed66466caa2fb52d939ec5c9 (table test-table [id=fafb08e588dd4a4c9e0b1ab8155e4ff5]) successfully deleted
W20260809 03:23:30.080919 10067 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.5.193:40363 (error 108)
I20260809 03:23:30.081123 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 10313
I20260809 03:23:30.083640 10793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:30.081275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:40363 (local address 127.0.0.1:38026)
0809 03:23:30.083534 (+ 2259us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:30.083597 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.193:40363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2229,"thread_start_us":60,"threads_started":1}
W20260809 03:23:30.083806 10067 catalog_manager.cc:4584] TS 53325eef37064d61b4c1e6ff915cd94c (127.8.5.193:40363): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet be3990f7ed66466caa2fb52d939ec5c9: Network error: Client connection negotiation failed: client connection to 127.8.5.193:40363: connect: Connection refused (error 111)
I20260809 03:23:30.088058 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 10467
I20260809 03:23:30.094717 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 10047
2026-08-09T03:23:30Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5794 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:23:30 dist-test-slave-2w3w krb5kdc[10796](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:23:30 dist-test-slave-2w3w krb5kdc[10796](info): set up 2 sockets
Aug 09 03:23:30 dist-test-slave-2w3w krb5kdc[10796](info): commencing operation
krb5kdc: starting...
W20260809 03:23:31.236936 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260809 03:23:31.438796 8215 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.202s user 0.000s sys 0.002s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260809 03:23:31.540165 8215 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.101s user 0.000s sys 0.002s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260809 03:23:31.765027 8215 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.225s user 0.000s sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/test-user.keytab.
W20260809 03:23:32.337162 8215 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.572s user 0.001s sys 0.001s
Aug 09 03:23:32 dist-test-slave-2w3w krb5kdc[10796](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:23:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
W20260809 03:23:32.555796 8215 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.8.5.254: real 0.197s user 0.003s sys 0.000s
I20260809 03:23:32.556120 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:40071
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:40071
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:32.637451 10809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:32.637687 10809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:32.637727 10809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:32.638873 10809 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:32.639053 10809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:32.639139 10809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:32.639174 10809 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:32.639204 10809 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:23:32.640921 10809 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:40071
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:40071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:32.641199 10809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:32.641438 10809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:32.646255 10816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:32.646267 10817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:32.646412 10809 server_base.cc:1034] running on GCE node
W20260809 03:23:32.646267 10820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:32.646754 10809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:32.647061 10809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:32.648203 10809 hybrid_clock.cc:648] HybridClock initialized: now 1786245812648195 us; error 27 us; skew 500 ppm
Aug 09 03:23:32 dist-test-slave-2w3w krb5kdc[10796](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245812, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:32.650712 10809 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:23:32.651217 10809 webserver.cc:460] Webserver started at http://127.8.5.254:45107/ using document root <none> and password file <none>
I20260809 03:23:32.651420 10809 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:32.651463 10809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:32.651557 10809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:32.652527 10809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "629e19de774b46c78716bd0a02c6ea09"
format_stamp: "Formatted at 2026-08-09 03:23:32 on dist-test-slave-2w3w"
server_key: "f82c1b8a17eda43011a23da506493eaf"
server_key_iv: "a9d96cfc0b9701f7d1c1632e5a8e21cd"
server_key_version: "encryptionkey@0"
I20260809 03:23:32.652837 10809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "629e19de774b46c78716bd0a02c6ea09"
format_stamp: "Formatted at 2026-08-09 03:23:32 on dist-test-slave-2w3w"
server_key: "f82c1b8a17eda43011a23da506493eaf"
server_key_iv: "a9d96cfc0b9701f7d1c1632e5a8e21cd"
server_key_version: "encryptionkey@0"
I20260809 03:23:32.654111 10809 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:23:32.654798 10827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:32.655035 10809 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:32.655133 10809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "629e19de774b46c78716bd0a02c6ea09"
format_stamp: "Formatted at 2026-08-09 03:23:32 on dist-test-slave-2w3w"
server_key: "f82c1b8a17eda43011a23da506493eaf"
server_key_iv: "a9d96cfc0b9701f7d1c1632e5a8e21cd"
server_key_version: "encryptionkey@0"
I20260809 03:23:32.655215 10809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:32.675698 10809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:32.677764 10809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:32.677940 10809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:32.682313 10809 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:40071
I20260809 03:23:32.682377 10885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:40071 every 8 connection(s)
I20260809 03:23:32.682751 10809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:32.683617 10886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:32.685844 10886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09: Bootstrap starting.
I20260809 03:23:32.686374 10886 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:32.686625 10886 log.cc:824] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:32.687292 10886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09: No bootstrap required, opened a new log
I20260809 03:23:32.688894 10886 raft_consensus.cc:348] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629e19de774b46c78716bd0a02c6ea09" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 40071 } }
I20260809 03:23:32.689031 10886 raft_consensus.cc:374] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:32.689054 10886 raft_consensus.cc:729] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629e19de774b46c78716bd0a02c6ea09, State: Initialized, Role: FOLLOWER
I20260809 03:23:32.689194 10886 consensus_queue.cc:260] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629e19de774b46c78716bd0a02c6ea09" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 40071 } }
I20260809 03:23:32.689280 10886 raft_consensus.cc:388] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:32.689302 10886 raft_consensus.cc:482] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:32.689333 10886 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:32.689843 10886 raft_consensus.cc:504] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629e19de774b46c78716bd0a02c6ea09" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 40071 } }
I20260809 03:23:32.689929 10886 leader_election.cc:302] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 629e19de774b46c78716bd0a02c6ea09; no voters:
I20260809 03:23:32.690071 10886 leader_election.cc:288] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:23:32.690157 10890 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:32.690351 10886 sys_catalog.cc:564] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:32.690631 10890 raft_consensus.cc:686] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09 [term 1 LEADER]: Becoming Leader. State: Replica: 629e19de774b46c78716bd0a02c6ea09, State: Running, Role: LEADER
I20260809 03:23:32.690732 10890 consensus_queue.cc:237] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629e19de774b46c78716bd0a02c6ea09" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 40071 } }
I20260809 03:23:32.691190 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 10809
I20260809 03:23:32.691289 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:23:32.691392 10891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "629e19de774b46c78716bd0a02c6ea09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629e19de774b46c78716bd0a02c6ea09" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 40071 } } }
I20260809 03:23:32.691470 10891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:32.691495 8215 external_mini_cluster.cc:1428] Setting key d20631a03dc78e1a3b88178f2c631485
I20260809 03:23:32.691890 10892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 629e19de774b46c78716bd0a02c6ea09. Latest consensus state: current_term: 1 leader_uuid: "629e19de774b46c78716bd0a02c6ea09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629e19de774b46c78716bd0a02c6ea09" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 40071 } } }
I20260809 03:23:32.691972 10892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09 [sys.catalog]: This master's current role is: LEADER
W20260809 03:23:32.692512 10906 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:23:32.692579 10906 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:23:32.692664 10902 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:32.692883 10902 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:32.694394 10902 catalog_manager.cc:1347] Generated new cluster ID: 083dd1b2087b468fa61d059a00a546e9
I20260809 03:23:32.694444 10902 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 03:23:32 dist-test-slave-2w3w krb5kdc[10796](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:32.703761 10909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:32.692173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51402 (local address 127.8.5.254:40071)
0809 03:23:32.692356 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:32.692366 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:32.692400 (+ 34us) server_negotiation.cc:407] Connection header received
0809 03:23:32.692522 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:32.692529 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:32.692584 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:32.692730 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:32.693514 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:32.694943 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:32.696039 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:32.696696 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:32.696821 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:32.699632 (+ 2811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:32.699636 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:32.699637 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:32.699649 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:32.701642 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:32.702229 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:32.702232 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:32.702233 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:32.702397 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:32.702717 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:32.702718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:32.702719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:32.703068 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:32.703248 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:32.703375 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 03:23:32.703520 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":89,"threads_started":1}
I20260809 03:23:32.704391 10902 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:23:32.704986 10902 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:32.710002 10902 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 629e19de774b46c78716bd0a02c6ea09: Generated new TSK 0
I20260809 03:23:32.710178 10902 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
I20260809 03:23:32.741756 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:40071
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:32.838922 10914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:32.839185 10914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:32.839212 10914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:32.840376 10914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:32.840418 10914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:32.840445 10914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:23:32.841930 10914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:40071
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:32.842177 10914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:32.842451 10914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:32.848098 10923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:32.848141 10919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:32.848152 10914 server_base.cc:1034] running on GCE node
W20260809 03:23:32.848109 10920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:32.848505 10914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:32.848793 10914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:32.849956 10914 hybrid_clock.cc:648] HybridClock initialized: now 1786245812849941 us; error 25 us; skew 500 ppm
Aug 09 03:23:32 dist-test-slave-2w3w krb5kdc[10796](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245812, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:32.852478 10914 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:23:32.852968 10914 webserver.cc:460] Webserver started at http://127.8.5.193:39489/ using document root <none> and password file <none>
I20260809 03:23:32.853183 10914 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:32.853248 10914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:32.853399 10914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:32.854388 10914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "b4f3c276a89a4707846b89401214dfae"
format_stamp: "Formatted at 2026-08-09 03:23:32 on dist-test-slave-2w3w"
server_key: "5e3f1dfd3574f3cdbac0d74d7748c853"
server_key_iv: "c47b3e5ec4be7bf48674d2332d21635d"
server_key_version: "encryptionkey@0"
I20260809 03:23:32.854746 10914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "b4f3c276a89a4707846b89401214dfae"
format_stamp: "Formatted at 2026-08-09 03:23:32 on dist-test-slave-2w3w"
server_key: "5e3f1dfd3574f3cdbac0d74d7748c853"
server_key_iv: "c47b3e5ec4be7bf48674d2332d21635d"
server_key_version: "encryptionkey@0"
I20260809 03:23:32.856151 10914 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:23:32.856874 10932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:32.857029 10914 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:32.857146 10914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "b4f3c276a89a4707846b89401214dfae"
format_stamp: "Formatted at 2026-08-09 03:23:32 on dist-test-slave-2w3w"
server_key: "5e3f1dfd3574f3cdbac0d74d7748c853"
server_key_iv: "c47b3e5ec4be7bf48674d2332d21635d"
server_key_version: "encryptionkey@0"
I20260809 03:23:32.857213 10914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:32.895112 10914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:32.896938 10914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:32.897050 10914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:32.897236 10914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:32.897584 10914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:32.897635 10914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:32.897691 10914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:32.897716 10914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:32.903792 10914 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:44503
I20260809 03:23:32.903849 11056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:44503 every 8 connection(s)
I20260809 03:23:32.904142 10914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:23:32.907830 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 10914
I20260809 03:23:32.907902 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:23:32.908074 8215 external_mini_cluster.cc:1428] Setting key 741537d71f5ed9e790eafd675d62e279
Aug 09 03:23:32 dist-test-slave-2w3w krb5kdc[10796](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245812, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:32.913341 10909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:32.904921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:36193 (local address 127.8.5.254:40071)
0809 03:23:32.905012 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:32.905015 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:32.905159 (+ 144us) server_negotiation.cc:407] Connection header received
0809 03:23:32.905619 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:32.905620 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:32.905631 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:32.905682 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:32.906583 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:32.907144 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:32.908138 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:32.908384 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:32.908439 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:32.910565 (+ 2126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:32.910566 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:32.910567 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:32.910574 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:32.911955 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:32.912362 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:32.912363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:32.912364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:32.912424 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:32.912683 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:32.912684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:32.912685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:32.912805 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:32.912890 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:32.913162 (+ 272us) server_negotiation.cc:299] Negotiation successful
0809 03:23:32.913252 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 03:23:32.913545 11059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:32.904869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:40071 (local address 127.8.5.193:36193)
0809 03:23:32.905036 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:32.905073 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:32.905538 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:32.905732 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:32.905734 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:32.906315 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:32.906504 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:32.906508 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:32.907220 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:32.907221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:32.908055 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:32.908058 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:32.908451 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:32.908452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:32.908586 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:32.909113 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:32.909120 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:32.910461 (+ 1341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:32.912039 (+ 1578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:32.912046 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:32.912049 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:32.912274 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:32.912496 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:32.912497 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:32.912497 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:32.912609 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:32.912879 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:32.912886 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:32.913031 (+ 145us) client_negotiation.cc:769] Sending connection context
0809 03:23:32.913138 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 03:23:32.913293 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
I20260809 03:23:32.914157 11057 heartbeater.cc:347] Connected to a master server at 127.8.5.254:40071
I20260809 03:23:32.914256 11057 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:32.914446 11057 heartbeater.cc:511] Master 127.8.5.254:40071 requested a full tablet report, sending...
I20260809 03:23:32.915035 10846 ts_manager.cc:194] Registered new tserver with Master: b4f3c276a89a4707846b89401214dfae (127.8.5.193:44503)
I20260809 03:23:32.915660 10846 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:36193
WARNING: no policy specified for kudu/127.8.5.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
I20260809 03:23:32.934109 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:40071
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:33.014171 11062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:33.014405 11062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:33.014444 11062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:33.015621 11062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:33.015693 11062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:33.015739 11062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:23:33.017246 11062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:40071
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:33.017503 11062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:33.017736 11062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:33.022799 11067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:33.022867 11062 server_base.cc:1034] running on GCE node
W20260809 03:23:33.022780 11069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:33.022760 11071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:33.023245 11062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:33.023481 11062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:33.024639 11062 hybrid_clock.cc:648] HybridClock initialized: now 1786245813024628 us; error 28 us; skew 500 ppm
Aug 09 03:23:33 dist-test-slave-2w3w krb5kdc[10796](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245813, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:33.027132 11062 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:23:33.027573 11062 webserver.cc:460] Webserver started at http://127.8.5.194:46151/ using document root <none> and password file <none>
I20260809 03:23:33.027776 11062 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:33.027817 11062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:33.027915 11062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:33.028913 11062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "3e823b7664a2442085e07e59fe617e68"
format_stamp: "Formatted at 2026-08-09 03:23:33 on dist-test-slave-2w3w"
server_key: "78d0bd8421d5e8077042dbf68a4c6393"
server_key_iv: "01fd603a65fcec8666670dcaf5242d15"
server_key_version: "encryptionkey@0"
I20260809 03:23:33.029208 11062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "3e823b7664a2442085e07e59fe617e68"
format_stamp: "Formatted at 2026-08-09 03:23:33 on dist-test-slave-2w3w"
server_key: "78d0bd8421d5e8077042dbf68a4c6393"
server_key_iv: "01fd603a65fcec8666670dcaf5242d15"
server_key_version: "encryptionkey@0"
I20260809 03:23:33.030475 11062 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:23:33.031222 11078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:33.031388 11062 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:33.031492 11062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "3e823b7664a2442085e07e59fe617e68"
format_stamp: "Formatted at 2026-08-09 03:23:33 on dist-test-slave-2w3w"
server_key: "78d0bd8421d5e8077042dbf68a4c6393"
server_key_iv: "01fd603a65fcec8666670dcaf5242d15"
server_key_version: "encryptionkey@0"
I20260809 03:23:33.031566 11062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:33.044476 11062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:33.047394 11062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:33.047557 11062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:33.047837 11062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:33.048166 11062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:33.048199 11062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:33.048241 11062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:33.048271 11062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:33.054926 11062 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:41659
I20260809 03:23:33.055109 11204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:41659 every 8 connection(s)
I20260809 03:23:33.055335 11062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:23:33.058580 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 11062
I20260809 03:23:33.058686 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:23:33.058882 8215 external_mini_cluster.cc:1428] Setting key 52fa97ae0bffc22d5a68f1dca06649b9
Aug 09 03:23:33 dist-test-slave-2w3w krb5kdc[10796](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245813, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:33.065467 10909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:33.056038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:51213 (local address 127.8.5.254:40071)
0809 03:23:33.056102 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:33.056104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:33.056306 (+ 202us) server_negotiation.cc:407] Connection header received
0809 03:23:33.056822 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:33.056823 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:33.056837 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:33.056901 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:33.057877 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:33.058461 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:33.059850 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:33.060134 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:33.060215 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:33.062577 (+ 2362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:33.062578 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:33.062579 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:33.062586 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:33.064088 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:33.064508 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:33.064509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:33.064509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:33.064569 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:33.064828 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:33.064829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:33.064829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:33.064943 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:33.065013 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:33.065290 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 03:23:33.065378 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 03:23:33.065666 11207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:33.056007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:40071 (local address 127.8.5.194:51213)
0809 03:23:33.056190 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:33.056224 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:33.056717 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:33.056966 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:33.056969 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:33.057585 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:33.057770 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:33.057774 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:33.058551 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:33.058552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:33.059737 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:33.059740 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:33.060227 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:33.060228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:33.060365 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:33.060896 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:33.060920 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:33.062469 (+ 1549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:33.064193 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:33.064200 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:33.064202 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:33.064429 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:33.064643 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:33.064643 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:33.064644 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:33.064748 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:33.065017 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:33.065024 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:33.065157 (+ 133us) client_negotiation.cc:769] Sending connection context
0809 03:23:33.065255 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 03:23:33.065413 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":96,"threads_started":1}
I20260809 03:23:33.066082 11205 heartbeater.cc:347] Connected to a master server at 127.8.5.254:40071
I20260809 03:23:33.066171 11205 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:33.066375 11205 heartbeater.cc:511] Master 127.8.5.254:40071 requested a full tablet report, sending...
I20260809 03:23:33.066766 10846 ts_manager.cc:194] Registered new tserver with Master: 3e823b7664a2442085e07e59fe617e68 (127.8.5.194:41659)
I20260809 03:23:33.067320 10846 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:51213
WARNING: no policy specified for kudu/127.8.5.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
I20260809 03:23:33.086472 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:40071
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:33.168623 11210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:33.168818 11210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:33.168840 11210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:33.169984 11210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:33.170027 11210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:33.170054 11210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:23:33.171538 11210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:40071
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:33.171777 11210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:33.171998 11210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:33.176811 11216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:33.176820 11217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:33.176820 11219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:33.176839 11210 server_base.cc:1034] running on GCE node
I20260809 03:23:33.177208 11210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:33.177441 11210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:33.178580 11210 hybrid_clock.cc:648] HybridClock initialized: now 1786245813178568 us; error 28 us; skew 500 ppm
Aug 09 03:23:33 dist-test-slave-2w3w krb5kdc[10796](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245813, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:33.184742 11210 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:23:33.185226 11210 webserver.cc:460] Webserver started at http://127.8.5.195:36287/ using document root <none> and password file <none>
I20260809 03:23:33.185463 11210 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:33.185509 11210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:33.185672 11210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:33.186684 11210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "7441094d908847729e903c356386f3e3"
format_stamp: "Formatted at 2026-08-09 03:23:33 on dist-test-slave-2w3w"
server_key: "4194c21049abf22e04b5701a7c052569"
server_key_iv: "16c1a83a29ef61179ec138cb792defd7"
server_key_version: "encryptionkey@0"
I20260809 03:23:33.187124 11210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "7441094d908847729e903c356386f3e3"
format_stamp: "Formatted at 2026-08-09 03:23:33 on dist-test-slave-2w3w"
server_key: "4194c21049abf22e04b5701a7c052569"
server_key_iv: "16c1a83a29ef61179ec138cb792defd7"
server_key_version: "encryptionkey@0"
I20260809 03:23:33.188476 11210 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:33.189245 11226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:33.189450 11210 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:33.189522 11210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "7441094d908847729e903c356386f3e3"
format_stamp: "Formatted at 2026-08-09 03:23:33 on dist-test-slave-2w3w"
server_key: "4194c21049abf22e04b5701a7c052569"
server_key_iv: "16c1a83a29ef61179ec138cb792defd7"
server_key_version: "encryptionkey@0"
I20260809 03:23:33.189606 11210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:33.207943 11210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:33.209709 11210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:33.209879 11210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:33.210120 11210 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:33.210517 11210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:33.210592 11210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:33.210634 11210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:33.210661 11210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:33.216480 11210 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:39237
I20260809 03:23:33.216526 11349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:39237 every 8 connection(s)
I20260809 03:23:33.216830 11210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:23:33.221478 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 11210
I20260809 03:23:33.221580 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:23:33.221752 8215 external_mini_cluster.cc:1428] Setting key 6bbee83a6381d8042e9f5a30562f0f43
Aug 09 03:23:33 dist-test-slave-2w3w krb5kdc[10796](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245813, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:33.225953 10909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:33.217550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:36213 (local address 127.8.5.254:40071)
0809 03:23:33.217633 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:33.217636 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:33.217818 (+ 182us) server_negotiation.cc:407] Connection header received
0809 03:23:33.218409 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:33.218410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:33.218424 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:33.218475 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:33.219468 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:33.219990 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:33.221000 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:33.221205 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:33.221279 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:33.223710 (+ 2431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:33.223711 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:33.223711 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:33.223718 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:33.224852 (+ 1134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:33.225199 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:33.225200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:33.225201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:33.225248 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:33.225460 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:33.225460 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:33.225461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:33.225559 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:33.225607 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:33.225829 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 03:23:33.225890 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 03:23:33.226176 11352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:33.217518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:40071 (local address 127.8.5.195:36213)
0809 03:23:33.217692 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:33.217737 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:33.218295 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:33.218541 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:33.218545 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:33.219173 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:33.219367 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:33.219372 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:33.220093 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:33.220094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:33.220898 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:33.220900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:33.221300 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:33.221301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:33.221430 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:33.221965 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:33.221976 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:33.223627 (+ 1651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:33.224922 (+ 1295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:33.224928 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:33.224929 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:33.225134 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:33.225302 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:33.225303 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:33.225303 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:33.225405 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:33.225611 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:33.225615 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:33.225721 (+ 106us) client_negotiation.cc:769] Sending connection context
0809 03:23:33.225798 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 03:23:33.225928 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":85,"threads_started":1}
I20260809 03:23:33.226635 11350 heartbeater.cc:347] Connected to a master server at 127.8.5.254:40071
I20260809 03:23:33.226748 11350 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:33.226930 11350 heartbeater.cc:511] Master 127.8.5.254:40071 requested a full tablet report, sending...
I20260809 03:23:33.227347 10846 ts_manager.cc:194] Registered new tserver with Master: 7441094d908847729e903c356386f3e3 (127.8.5.195:39237)
I20260809 03:23:33.227703 10846 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:36213
I20260809 03:23:33.233704 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 03:23:33.246184 10909 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:33.245348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51410 (local address 127.8.5.254:40071)
0809 03:23:33.245417 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:33.245419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:33.245534 (+ 115us) server_negotiation.cc:407] Connection header received
0809 03:23:33.245575 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:33.245576 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:33.245586 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:33.245647 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:33.246126 (+ 479us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51410: BlockingRecv error: recv got EOF from 127.0.0.1:51410 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 03:23:33.247208 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 10914
I20260809 03:23:33.254755 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 11062
I20260809 03:23:33.260116 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 11210
I20260809 03:23:33.265499 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 10809
2026-08-09T03:23:33Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3168 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:23:33 dist-test-slave-2w3w krb5kdc[11362](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:23:33 dist-test-slave-2w3w krb5kdc[11362](info): set up 2 sockets
Aug 09 03:23:33 dist-test-slave-2w3w krb5kdc[11362](info): commencing operation
krb5kdc: starting...
W20260809 03:23:34.335770 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:23:34 dist-test-slave-2w3w krb5kdc[11362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:23:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:23:34.457911 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:43637
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:43637
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:34.538682 11376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:34.538885 11376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:34.538908 11376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:34.540114 11376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:34.540158 11376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:34.540172 11376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:34.540210 11376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:34.540236 11376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:23:34.541707 11376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:43637
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:43637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:34.541963 11376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:34.542196 11376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 03:23:34.547194 11376 server_base.cc:1034] running on GCE node
W20260809 03:23:34.547179 11381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:34.547176 11384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:34.547164 11382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:34.547640 11376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:34.547935 11376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:34.549084 11376 hybrid_clock.cc:648] HybridClock initialized: now 1786245814549065 us; error 34 us; skew 500 ppm
Aug 09 03:23:34 dist-test-slave-2w3w krb5kdc[11362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245814, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:34.551559 11376 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:23:34.552063 11376 webserver.cc:460] Webserver started at http://127.8.5.254:33861/ using document root <none> and password file <none>
I20260809 03:23:34.552296 11376 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:34.552366 11376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:34.552520 11376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:34.553565 11376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "59d2a76ff952497a95befb61e737d836"
format_stamp: "Formatted at 2026-08-09 03:23:34 on dist-test-slave-2w3w"
server_key: "f783edae1fcc68f3af3533654cbc595c"
server_key_iv: "a9b8b4c9445a6051e9aa09c409c60a0c"
server_key_version: "encryptionkey@0"
I20260809 03:23:34.553936 11376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "59d2a76ff952497a95befb61e737d836"
format_stamp: "Formatted at 2026-08-09 03:23:34 on dist-test-slave-2w3w"
server_key: "f783edae1fcc68f3af3533654cbc595c"
server_key_iv: "a9b8b4c9445a6051e9aa09c409c60a0c"
server_key_version: "encryptionkey@0"
I20260809 03:23:34.555353 11376 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:23:34.556102 11391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:34.556272 11376 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:23:34.556371 11376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "59d2a76ff952497a95befb61e737d836"
format_stamp: "Formatted at 2026-08-09 03:23:34 on dist-test-slave-2w3w"
server_key: "f783edae1fcc68f3af3533654cbc595c"
server_key_iv: "a9b8b4c9445a6051e9aa09c409c60a0c"
server_key_version: "encryptionkey@0"
I20260809 03:23:34.556460 11376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:34.588078 11376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:34.589986 11376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:34.590171 11376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:34.594619 11376 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:43637
I20260809 03:23:34.594671 11445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:43637 every 8 connection(s)
I20260809 03:23:34.595118 11376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:34.596032 11446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:34.598282 11446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836: Bootstrap starting.
I20260809 03:23:34.598825 11446 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:34.599157 11446 log.cc:824] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:34.599793 11446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836: No bootstrap required, opened a new log
I20260809 03:23:34.601303 11446 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59d2a76ff952497a95befb61e737d836" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43637 } }
I20260809 03:23:34.601449 11446 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:34.601471 11446 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d2a76ff952497a95befb61e737d836, State: Initialized, Role: FOLLOWER
I20260809 03:23:34.601572 11446 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59d2a76ff952497a95befb61e737d836" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43637 } }
I20260809 03:23:34.601651 11446 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:34.601684 11446 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:34.601739 11446 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:34.602530 11446 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59d2a76ff952497a95befb61e737d836" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43637 } }
I20260809 03:23:34.602648 11446 leader_election.cc:302] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59d2a76ff952497a95befb61e737d836; no voters:
I20260809 03:23:34.602849 11446 leader_election.cc:288] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:23:34.602900 11449 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:34.603109 11449 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836 [term 1 LEADER]: Becoming Leader. State: Replica: 59d2a76ff952497a95befb61e737d836, State: Running, Role: LEADER
I20260809 03:23:34.603130 11446 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:34.603230 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 11376
I20260809 03:23:34.603319 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:23:34.603279 11449 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59d2a76ff952497a95befb61e737d836" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43637 } }
I20260809 03:23:34.603505 8215 external_mini_cluster.cc:1428] Setting key dda9c78435e642d9851f194f66967376
I20260809 03:23:34.603643 11451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59d2a76ff952497a95befb61e737d836" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59d2a76ff952497a95befb61e737d836" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43637 } } }
I20260809 03:23:34.603739 11451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:34.604001 11452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59d2a76ff952497a95befb61e737d836. Latest consensus state: current_term: 1 leader_uuid: "59d2a76ff952497a95befb61e737d836" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59d2a76ff952497a95befb61e737d836" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43637 } } }
I20260809 03:23:34.604368 11452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:34.604473 11458 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:34.605068 11458 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:34.606981 11458 catalog_manager.cc:1347] Generated new cluster ID: c0526eafcf574b84a355a97286fd7239
I20260809 03:23:34.607038 11458 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 03:23:34 dist-test-slave-2w3w krb5kdc[11362](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:34.615830 11463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:34.604112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47704 (local address 127.8.5.254:43637)
0809 03:23:34.604551 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:34.604561 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:34.604603 (+ 42us) server_negotiation.cc:407] Connection header received
0809 03:23:34.604728 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:34.604834 (+ 106us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:34.604909 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:34.605049 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:34.605883 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:34.607340 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:34.608397 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:34.609020 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:34.609114 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:34.611895 (+ 2781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:34.611899 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:34.611899 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:34.611911 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:34.614066 (+ 2155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:34.614487 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:34.614490 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:34.614490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:34.614608 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:34.614834 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:34.614835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:34.614836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:34.615202 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:34.615370 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:34.615456 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 03:23:34.615610 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":83,"threads_started":1}
I20260809 03:23:34.616770 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:23:34.631734 11458 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:23:34.632422 11458 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:34.637565 11463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:34.633226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47710 (local address 127.8.5.254:43637)
0809 03:23:34.633266 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:34.633267 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:34.633438 (+ 171us) server_negotiation.cc:407] Connection header received
0809 03:23:34.633495 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:34.633496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:34.633508 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:34.633574 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:34.633997 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:34.634811 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:34.635876 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:34.636222 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:34.636299 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:34.637046 (+ 747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:34.637048 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:34.637048 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:23:34.637302 (+ 254us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:34.637321 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:23:34.637329 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:34.637393 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:34.637452 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 03:23:34.637486 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:23:34.641734 11458 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59d2a76ff952497a95befb61e737d836: Generated new TSK 0
I20260809 03:23:34.641916 11458 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:23:34.646525 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 11376
2026-08-09T03:23:34Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1382 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:23:34 dist-test-slave-2w3w krb5kdc[11482](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:23:34 dist-test-slave-2w3w krb5kdc[11482](info): set up 2 sockets
Aug 09 03:23:34 dist-test-slave-2w3w krb5kdc[11482](info): commencing operation
krb5kdc: starting...
W20260809 03:23:35.721115 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:23:35 dist-test-slave-2w3w krb5kdc[11482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:23:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:23:35.838529 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:39489
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:42367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:39489
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:35.919253 11498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:35.919518 11498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:35.919556 11498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:35.920729 11498 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:35.920797 11498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:35.920825 11498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:35.920857 11498 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:35.920884 11498 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:23:35.922370 11498 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:42367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:39489
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:39489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:35.922647 11498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:35.922900 11498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:35.927805 11507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:35.927793 11506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:35.927793 11509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:35.928105 11498 server_base.cc:1034] running on GCE node
I20260809 03:23:35.928359 11498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:35.928653 11498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:35.929807 11498 hybrid_clock.cc:648] HybridClock initialized: now 1786245815929786 us; error 36 us; skew 500 ppm
Aug 09 03:23:35 dist-test-slave-2w3w krb5kdc[11482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245815, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:35.932309 11498 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:23:35.932756 11498 webserver.cc:460] Webserver started at http://127.8.5.254:44569/ using document root <none> and password file <none>
I20260809 03:23:35.933000 11498 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:35.933045 11498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:35.933178 11498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:35.934192 11498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "f153afb0a2264e80af62650820984076"
format_stamp: "Formatted at 2026-08-09 03:23:35 on dist-test-slave-2w3w"
server_key: "9b013425d3acf97867d0688bbdd96320"
server_key_iv: "277254e8c91edcef7b0242bac13457c5"
server_key_version: "encryptionkey@0"
I20260809 03:23:35.934593 11498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "f153afb0a2264e80af62650820984076"
format_stamp: "Formatted at 2026-08-09 03:23:35 on dist-test-slave-2w3w"
server_key: "9b013425d3acf97867d0688bbdd96320"
server_key_iv: "277254e8c91edcef7b0242bac13457c5"
server_key_version: "encryptionkey@0"
I20260809 03:23:35.936074 11498 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 03:23:35.936863 11516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:35.937048 11498 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:35.937155 11498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "f153afb0a2264e80af62650820984076"
format_stamp: "Formatted at 2026-08-09 03:23:35 on dist-test-slave-2w3w"
server_key: "9b013425d3acf97867d0688bbdd96320"
server_key_iv: "277254e8c91edcef7b0242bac13457c5"
server_key_version: "encryptionkey@0"
I20260809 03:23:35.937240 11498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:35.947258 11498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:35.949007 11498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:35.949186 11498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:35.953346 11498 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:39489
I20260809 03:23:35.953379 11568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:39489 every 8 connection(s)
I20260809 03:23:35.953703 11498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:35.954722 11569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:35.956935 11569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076: Bootstrap starting.
I20260809 03:23:35.957464 11569 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:35.957697 11569 log.cc:824] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:35.958331 11569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076: No bootstrap required, opened a new log
I20260809 03:23:35.960361 11569 raft_consensus.cc:348] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f153afb0a2264e80af62650820984076" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 39489 } }
I20260809 03:23:35.960490 11569 raft_consensus.cc:374] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:35.960512 11569 raft_consensus.cc:729] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f153afb0a2264e80af62650820984076, State: Initialized, Role: FOLLOWER
I20260809 03:23:35.960633 11569 consensus_queue.cc:260] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f153afb0a2264e80af62650820984076" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 39489 } }
I20260809 03:23:35.960713 11569 raft_consensus.cc:388] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:35.960736 11569 raft_consensus.cc:482] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:35.960763 11569 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:35.961512 11569 raft_consensus.cc:504] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f153afb0a2264e80af62650820984076" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 39489 } }
I20260809 03:23:35.961596 11569 leader_election.cc:302] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f153afb0a2264e80af62650820984076; no voters:
I20260809 03:23:35.961711 11569 leader_election.cc:288] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:23:35.961783 11572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:35.961941 11572 raft_consensus.cc:686] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076 [term 1 LEADER]: Becoming Leader. State: Replica: f153afb0a2264e80af62650820984076, State: Running, Role: LEADER
I20260809 03:23:35.961980 11569 sys_catalog.cc:564] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:35.962033 11572 consensus_queue.cc:237] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f153afb0a2264e80af62650820984076" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 39489 } }
I20260809 03:23:35.962425 11574 sys_catalog.cc:455] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f153afb0a2264e80af62650820984076. Latest consensus state: current_term: 1 leader_uuid: "f153afb0a2264e80af62650820984076" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f153afb0a2264e80af62650820984076" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 39489 } } }
I20260809 03:23:35.962517 11574 sys_catalog.cc:458] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:35.962415 11573 sys_catalog.cc:455] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f153afb0a2264e80af62650820984076" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f153afb0a2264e80af62650820984076" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 39489 } } }
I20260809 03:23:35.962919 11573 sys_catalog.cc:458] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:35.963029 11581 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:35.963137 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 11498
I20260809 03:23:35.963258 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:23:35.963477 8215 external_mini_cluster.cc:1428] Setting key b12b1e0ff986d3524dfa42a197f3490a
I20260809 03:23:35.963585 11581 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:35.965154 11581 catalog_manager.cc:1347] Generated new cluster ID: 0df3277f0fae4f28b723f5701c29ab07
I20260809 03:23:35.965210 11581 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 03:23:35 dist-test-slave-2w3w krb5kdc[11482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:35.973237 11592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:35.963951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52006 (local address 127.8.5.254:39489)
0809 03:23:35.964135 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:35.964145 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:35.964180 (+ 35us) server_negotiation.cc:407] Connection header received
0809 03:23:35.964327 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:35.964332 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:35.964381 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:35.964513 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:35.965282 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:35.966168 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:35.966941 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:35.967421 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:35.967550 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:35.969914 (+ 2364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:35.969918 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:35.969919 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:35.969934 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:35.971663 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:35.972051 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:35.972054 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:35.972054 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:35.972157 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:35.972376 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:35.972377 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:35.972378 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:35.972622 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:35.972790 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:35.972894 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 03:23:35.973037 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":80,"threads_started":1}
I20260809 03:23:35.981462 11581 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:23:35.981998 11581 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:35.988710 11581 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f153afb0a2264e80af62650820984076: Generated new TSK 0
I20260809 03:23:35.988894 11581 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
I20260809 03:23:36.022189 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:39489
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:42367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:36.108803 11596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:36.108997 11596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:36.109020 11596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:36.110356 11596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:36.110399 11596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:36.110425 11596 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:23:36.111874 11596 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:42367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:39489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:36.112116 11596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:36.112365 11596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:36.117308 11607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:36.117303 11602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:36.117365 11596 server_base.cc:1034] running on GCE node
W20260809 03:23:36.117331 11604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:36.117686 11596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:36.117974 11596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:36.119134 11596 hybrid_clock.cc:648] HybridClock initialized: now 1786245816119126 us; error 41 us; skew 500 ppm
Aug 09 03:23:36 dist-test-slave-2w3w krb5kdc[11482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245816, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:36.121557 11596 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:23:36.122004 11596 webserver.cc:460] Webserver started at http://127.8.5.193:34939/ using document root <none> and password file <none>
I20260809 03:23:36.122246 11596 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:36.122313 11596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:36.122463 11596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:36.123550 11596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "987dd320005844739195a614a80b33ba"
format_stamp: "Formatted at 2026-08-09 03:23:36 on dist-test-slave-2w3w"
server_key: "ab402ddfdd21f50bef6b868901e9efc8"
server_key_iv: "5864dce384e53145af4425d87cc38b03"
server_key_version: "encryptionkey@0"
I20260809 03:23:36.123930 11596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "987dd320005844739195a614a80b33ba"
format_stamp: "Formatted at 2026-08-09 03:23:36 on dist-test-slave-2w3w"
server_key: "ab402ddfdd21f50bef6b868901e9efc8"
server_key_iv: "5864dce384e53145af4425d87cc38b03"
server_key_version: "encryptionkey@0"
I20260809 03:23:36.125223 11596 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 03:23:36.125968 11614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:36.126142 11596 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:23:36.126240 11596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "987dd320005844739195a614a80b33ba"
format_stamp: "Formatted at 2026-08-09 03:23:36 on dist-test-slave-2w3w"
server_key: "ab402ddfdd21f50bef6b868901e9efc8"
server_key_iv: "5864dce384e53145af4425d87cc38b03"
server_key_version: "encryptionkey@0"
I20260809 03:23:36.126315 11596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:36.139421 11596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:36.141291 11596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:36.141443 11596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:36.141666 11596 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:36.141971 11596 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:36.142026 11596 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:36.142067 11596 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:36.142094 11596 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:36.147904 11596 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:32987
I20260809 03:23:36.148006 11736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:32987 every 8 connection(s)
I20260809 03:23:36.148285 11596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
Aug 09 03:23:36 dist-test-slave-2w3w krb5kdc[11482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245816, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:36.157059 11592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:36.149147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:45031 (local address 127.8.5.254:39489)
0809 03:23:36.149223 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:36.149225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:36.149405 (+ 180us) server_negotiation.cc:407] Connection header received
0809 03:23:36.149895 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:36.149896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:36.149909 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:36.149961 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:36.150805 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:36.151377 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:36.152319 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:36.152513 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:36.152563 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:36.154488 (+ 1925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:36.154489 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:36.154489 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:36.154495 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:36.155942 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:36.156278 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:36.156279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:36.156279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:36.156329 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:36.156539 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:36.156540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:36.156540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:36.156633 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:36.156680 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:36.156921 (+ 241us) server_negotiation.cc:299] Negotiation successful
0809 03:23:36.156993 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 03:23:36.157204 11739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:36.149099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:39489 (local address 127.8.5.193:45031)
0809 03:23:36.149283 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:36.149324 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:36.149771 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:36.150011 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:36.150014 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:36.150542 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:36.150722 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:36.150726 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:36.151459 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:36.151459 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:36.152246 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:36.152249 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:36.152586 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:36.152586 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:36.152686 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:36.153111 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:36.153119 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:36.154405 (+ 1286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:36.156007 (+ 1602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:36.156013 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:36.156014 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:36.156214 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:36.156388 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:36.156389 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:36.156389 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:36.156485 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:36.156686 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:36.156690 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:36.156792 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 03:23:36.156892 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 03:23:36.157003 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":102,"threads_started":1}
I20260809 03:23:36.157742 11737 heartbeater.cc:347] Connected to a master server at 127.8.5.254:39489
I20260809 03:23:36.157853 11737 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:36.157824 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 11596
I20260809 03:23:36.157940 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:23:36.158056 11737 heartbeater.cc:511] Master 127.8.5.254:39489 requested a full tablet report, sending...
I20260809 03:23:36.158149 8215 external_mini_cluster.cc:1428] Setting key 816a07f5f70bdf21c541aca32bc3c5e2
I20260809 03:23:36.158619 11533 ts_manager.cc:194] Registered new tserver with Master: 987dd320005844739195a614a80b33ba (127.8.5.193:32987)
I20260809 03:23:36.159363 11533 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:45031
WARNING: no policy specified for kudu/127.8.5.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
I20260809 03:23:36.185859 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:39489
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:42367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:36.265596 11743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:36.265810 11743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:36.265846 11743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:36.267066 11743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:36.267114 11743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:36.267156 11743 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:23:36.268617 11743 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:42367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:39489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:36.268904 11743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:36.269140 11743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:36.273960 11751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:36.273976 11749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:36.274138 11743 server_base.cc:1034] running on GCE node
W20260809 03:23:36.273990 11748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:36.274415 11743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:36.274657 11743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:36.275826 11743 hybrid_clock.cc:648] HybridClock initialized: now 1786245816275807 us; error 36 us; skew 500 ppm
Aug 09 03:23:36 dist-test-slave-2w3w krb5kdc[11482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245816, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:36.278414 11743 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:23:36.278820 11743 webserver.cc:460] Webserver started at http://127.8.5.194:38619/ using document root <none> and password file <none>
I20260809 03:23:36.279103 11743 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:36.279150 11743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:36.279296 11743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:36.280377 11743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "31f9ff95a751435094480594bf78b65b"
format_stamp: "Formatted at 2026-08-09 03:23:36 on dist-test-slave-2w3w"
server_key: "20f9041c1d7ff57f5c096740b04a7503"
server_key_iv: "489b0e4b0fa5582165bea151697da1bf"
server_key_version: "encryptionkey@0"
I20260809 03:23:36.280721 11743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "31f9ff95a751435094480594bf78b65b"
format_stamp: "Formatted at 2026-08-09 03:23:36 on dist-test-slave-2w3w"
server_key: "20f9041c1d7ff57f5c096740b04a7503"
server_key_iv: "489b0e4b0fa5582165bea151697da1bf"
server_key_version: "encryptionkey@0"
I20260809 03:23:36.282020 11743 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:23:36.282711 11759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:36.282905 11743 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:36.283012 11743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "31f9ff95a751435094480594bf78b65b"
format_stamp: "Formatted at 2026-08-09 03:23:36 on dist-test-slave-2w3w"
server_key: "20f9041c1d7ff57f5c096740b04a7503"
server_key_iv: "489b0e4b0fa5582165bea151697da1bf"
server_key_version: "encryptionkey@0"
I20260809 03:23:36.283084 11743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:36.294417 11743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:36.296231 11743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:36.296392 11743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:36.296607 11743 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:36.296916 11743 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:36.296948 11743 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:36.296969 11743 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:36.297015 11743 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:36.302584 11743 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:39743
I20260809 03:23:36.302657 11882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:39743 every 8 connection(s)
I20260809 03:23:36.303006 11743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
Aug 09 03:23:36 dist-test-slave-2w3w krb5kdc[11482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245816, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:36.310513 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 11743
I20260809 03:23:36.310633 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:23:36.310834 8215 external_mini_cluster.cc:1428] Setting key 0ad32e363755df5576234d6a9a605f29
I20260809 03:23:36.312500 11592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:36.303816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:58523 (local address 127.8.5.254:39489)
0809 03:23:36.303871 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:36.303873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:36.304077 (+ 204us) server_negotiation.cc:407] Connection header received
0809 03:23:36.304623 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:36.304625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:36.304637 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:36.304685 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:36.305621 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:36.306143 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:36.307224 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:36.307434 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:36.307507 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:36.309542 (+ 2035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:36.309544 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:36.309544 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:36.309551 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:36.311063 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:36.311535 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:36.311536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:36.311536 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:36.311604 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:36.311893 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:36.311894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:36.311894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:36.311996 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:36.312060 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:36.312374 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 03:23:36.312439 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:23:36.312790 11885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:36.303781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:39489 (local address 127.8.5.194:58523)
0809 03:23:36.303963 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:36.303998 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:36.304508 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:36.304764 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:36.304768 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:36.305328 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:36.305520 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:36.305524 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:36.306240 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:36.306241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:36.307124 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:36.307126 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:36.307526 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:36.307527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:36.307662 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:36.308089 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:36.308097 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:36.309435 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:36.311160 (+ 1725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:36.311168 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:36.311170 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:36.311460 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:36.311675 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:36.311676 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:36.311677 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:36.311821 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:36.312073 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:36.312078 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:36.312235 (+ 157us) client_negotiation.cc:769] Sending connection context
0809 03:23:36.312357 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 03:23:36.312531 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":90,"threads_started":1}
I20260809 03:23:36.313289 11883 heartbeater.cc:347] Connected to a master server at 127.8.5.254:39489
I20260809 03:23:36.313426 11883 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:36.313637 11883 heartbeater.cc:511] Master 127.8.5.254:39489 requested a full tablet report, sending...
I20260809 03:23:36.314087 11533 ts_manager.cc:194] Registered new tserver with Master: 31f9ff95a751435094480594bf78b65b (127.8.5.194:39743)
I20260809 03:23:36.314586 11533 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:58523
WARNING: no policy specified for kudu/127.8.5.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
I20260809 03:23:36.335919 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:39489
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:42367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:36.416239 11888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:36.416424 11888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:36.416448 11888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:36.417573 11888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:36.417615 11888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:36.417640 11888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:23:36.419153 11888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:42367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:39489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:36.419395 11888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:36.419639 11888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:36.424582 11894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:36.424595 11897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:36.424602 11895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:36.424821 11888 server_base.cc:1034] running on GCE node
I20260809 03:23:36.425047 11888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:36.425236 11888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:36.426394 11888 hybrid_clock.cc:648] HybridClock initialized: now 1786245816426422 us; error 72 us; skew 500 ppm
Aug 09 03:23:36 dist-test-slave-2w3w krb5kdc[11482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245816, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:36.428910 11888 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:23:36.429490 11888 webserver.cc:460] Webserver started at http://127.8.5.195:37961/ using document root <none> and password file <none>
I20260809 03:23:36.429733 11888 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:36.429787 11888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:36.429975 11888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:36.431113 11888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "52f694689ac54d09b1d5cac80695c73b"
format_stamp: "Formatted at 2026-08-09 03:23:36 on dist-test-slave-2w3w"
server_key: "0647273ff262a47ced6007f3f441b90f"
server_key_iv: "f54378d157c5cda7d0e8499a76ca50f6"
server_key_version: "encryptionkey@0"
I20260809 03:23:36.431471 11888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "52f694689ac54d09b1d5cac80695c73b"
format_stamp: "Formatted at 2026-08-09 03:23:36 on dist-test-slave-2w3w"
server_key: "0647273ff262a47ced6007f3f441b90f"
server_key_iv: "f54378d157c5cda7d0e8499a76ca50f6"
server_key_version: "encryptionkey@0"
I20260809 03:23:36.432833 11888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:23:36.433610 11905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:36.433981 11888 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:36.434072 11888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "52f694689ac54d09b1d5cac80695c73b"
format_stamp: "Formatted at 2026-08-09 03:23:36 on dist-test-slave-2w3w"
server_key: "0647273ff262a47ced6007f3f441b90f"
server_key_iv: "f54378d157c5cda7d0e8499a76ca50f6"
server_key_version: "encryptionkey@0"
I20260809 03:23:36.434145 11888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:36.455039 11888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:36.456771 11888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:36.456928 11888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:36.457145 11888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:36.457445 11888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:36.457479 11888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:36.457520 11888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:36.457547 11888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:36.463719 11888 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:42785
I20260809 03:23:36.463774 12030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:42785 every 8 connection(s)
I20260809 03:23:36.464116 11888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
Aug 09 03:23:36 dist-test-slave-2w3w krb5kdc[11482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245816, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:36.470507 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 11888
I20260809 03:23:36.470615 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:23:36.470817 8215 external_mini_cluster.cc:1428] Setting key 2c6d0d15d8488e56c74a2dd9de6b9325
I20260809 03:23:36.473376 11592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:36.464827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:37943 (local address 127.8.5.254:39489)
0809 03:23:36.464892 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:36.464894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:36.465098 (+ 204us) server_negotiation.cc:407] Connection header received
0809 03:23:36.465623 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:36.465624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:36.465637 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:36.465688 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:36.466642 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:36.467210 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:36.468257 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:36.468465 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:36.468540 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:36.470673 (+ 2133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:36.470675 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:36.470675 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:36.470684 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:36.472239 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:36.472587 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:36.472588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:36.472588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:36.472636 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:36.472866 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:36.472867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:36.472867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:36.472961 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:36.473008 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:36.473260 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 03:23:36.473316 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 03:23:36.473608 12033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:36.464811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:39489 (local address 127.8.5.195:37943)
0809 03:23:36.464987 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:36.465021 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:36.465513 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:36.465754 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:36.465762 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:36.466344 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:36.466519 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:36.466524 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:36.467299 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:36.467300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:36.468163 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:36.468166 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:36.468547 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:36.468548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:36.468670 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:36.469115 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:36.469122 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:36.470565 (+ 1443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:36.472307 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:36.472312 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:36.472314 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:36.472522 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:36.472694 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:36.472694 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:36.472694 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:36.472786 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:36.473014 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:36.473018 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:36.473120 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 03:23:36.473244 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 03:23:36.473418 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":97,"threads_started":1}
I20260809 03:23:36.474102 12031 heartbeater.cc:347] Connected to a master server at 127.8.5.254:39489
I20260809 03:23:36.474205 12031 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:36.474373 12031 heartbeater.cc:511] Master 127.8.5.254:39489 requested a full tablet report, sending...
I20260809 03:23:36.474752 11533 ts_manager.cc:194] Registered new tserver with Master: 52f694689ac54d09b1d5cac80695c73b (127.8.5.195:42785)
I20260809 03:23:36.475147 11533 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:37943
I20260809 03:23:36.482405 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 03:23:36 dist-test-slave-2w3w krb5kdc[11482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245816, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 03:23:36 dist-test-slave-2w3w krb5kdc[11482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245816, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:36.505638 11592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:36.499057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52012 (local address 127.8.5.254:39489)
0809 03:23:36.499114 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:36.499116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:36.499235 (+ 119us) server_negotiation.cc:407] Connection header received
0809 03:23:36.499279 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:36.499280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:36.499288 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:36.499346 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:36.499887 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:36.500365 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:36.501081 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:36.501255 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:36.501304 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:36.503424 (+ 2120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:36.503426 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:36.503426 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:36.503432 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:36.504651 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:36.504960 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:36.504961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:36.504961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:36.505009 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:36.505182 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:36.505183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:36.505183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:36.505328 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:36.505414 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:36.505517 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 03:23:36.505576 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260809 03:23:36.505839 11533 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:52012
I20260809 03:23:36.506263 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 11596
I20260809 03:23:36.513124 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 11743
I20260809 03:23:36.518044 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 11888
I20260809 03:23:36.523993 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 11498
2026-08-09T03:23:36Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1876 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:23:36 dist-test-slave-2w3w krb5kdc[12043](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:23:36 dist-test-slave-2w3w krb5kdc[12043](info): set up 2 sockets
Aug 09 03:23:36 dist-test-slave-2w3w krb5kdc[12043](info): commencing operation
krb5kdc: starting...
W20260809 03:23:37.596124 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:23:37 dist-test-slave-2w3w krb5kdc[12043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:23:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:23:37.714120 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:45943
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:46841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:45943
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:37.796113 12059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:37.796356 12059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:37.796392 12059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:37.797529 12059 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:37.797597 12059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:37.797621 12059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:37.797640 12059 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:37.797672 12059 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:23:37.799198 12059 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:46841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:45943
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:45943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12059
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:37.799475 12059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:37.799741 12059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 03:23:37.804631 12059 server_base.cc:1034] running on GCE node
W20260809 03:23:37.804605 12067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:37.804592 12064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:37.804576 12065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:37.805003 12059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:37.805346 12059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:37.806516 12059 hybrid_clock.cc:648] HybridClock initialized: now 1786245817806500 us; error 41 us; skew 500 ppm
Aug 09 03:23:37 dist-test-slave-2w3w krb5kdc[12043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245817, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:37.809141 12059 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:23:37.809605 12059 webserver.cc:460] Webserver started at http://127.8.5.254:42037/ using document root <none> and password file <none>
I20260809 03:23:37.809863 12059 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:37.809938 12059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:37.810084 12059 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:37.811214 12059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "9c6eefdac4254152a09216b069ba8968"
format_stamp: "Formatted at 2026-08-09 03:23:37 on dist-test-slave-2w3w"
server_key: "12b6c5f58c66f48ce38abfe7e2e5d19b"
server_key_iv: "254c401e28a5aca3fb3c8b8263e9880d"
server_key_version: "encryptionkey@0"
I20260809 03:23:37.811564 12059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "9c6eefdac4254152a09216b069ba8968"
format_stamp: "Formatted at 2026-08-09 03:23:37 on dist-test-slave-2w3w"
server_key: "12b6c5f58c66f48ce38abfe7e2e5d19b"
server_key_iv: "254c401e28a5aca3fb3c8b8263e9880d"
server_key_version: "encryptionkey@0"
I20260809 03:23:37.812947 12059 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:37.813704 12074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:37.813915 12059 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:37.814005 12059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "9c6eefdac4254152a09216b069ba8968"
format_stamp: "Formatted at 2026-08-09 03:23:37 on dist-test-slave-2w3w"
server_key: "12b6c5f58c66f48ce38abfe7e2e5d19b"
server_key_iv: "254c401e28a5aca3fb3c8b8263e9880d"
server_key_version: "encryptionkey@0"
I20260809 03:23:37.814057 12059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:37.836460 12059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:37.838253 12059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:37.838367 12059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:37.842279 12059 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:45943
I20260809 03:23:37.842335 12130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:45943 every 8 connection(s)
I20260809 03:23:37.842877 12059 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:37.843581 12131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:37.845816 12131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968: Bootstrap starting.
I20260809 03:23:37.846392 12131 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:37.846720 12131 log.cc:824] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:37.847491 12131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968: No bootstrap required, opened a new log
I20260809 03:23:37.849010 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 12059
I20260809 03:23:37.849093 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:23:37.849095 12131 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c6eefdac4254152a09216b069ba8968" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45943 } }
I20260809 03:23:37.849270 12131 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:37.849279 8215 external_mini_cluster.cc:1428] Setting key 389cefdfa64cdea6c9a095cdc8cffbb1
I20260809 03:23:37.849318 12131 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c6eefdac4254152a09216b069ba8968, State: Initialized, Role: FOLLOWER
I20260809 03:23:37.849496 12131 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c6eefdac4254152a09216b069ba8968" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45943 } }
I20260809 03:23:37.849604 12131 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:37.849658 12131 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:37.849711 12131 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:37.850209 12131 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c6eefdac4254152a09216b069ba8968" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45943 } }
I20260809 03:23:37.850327 12131 leader_election.cc:302] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c6eefdac4254152a09216b069ba8968; no voters:
I20260809 03:23:37.850514 12131 leader_election.cc:288] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:23:37.850548 12138 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:37.850804 12138 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968 [term 1 LEADER]: Becoming Leader. State: Replica: 9c6eefdac4254152a09216b069ba8968, State: Running, Role: LEADER
I20260809 03:23:37.850826 12131 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:37.850893 12138 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c6eefdac4254152a09216b069ba8968" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45943 } }
I20260809 03:23:37.851476 12140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c6eefdac4254152a09216b069ba8968" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c6eefdac4254152a09216b069ba8968" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45943 } } }
I20260809 03:23:37.851563 12140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:37.851464 12141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c6eefdac4254152a09216b069ba8968. Latest consensus state: current_term: 1 leader_uuid: "9c6eefdac4254152a09216b069ba8968" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c6eefdac4254152a09216b069ba8968" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45943 } } }
I20260809 03:23:37.851703 12141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968 [sys.catalog]: This master's current role is: LEADER
W20260809 03:23:37.853084 12155 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:23:37.853143 12155 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:23:37.853575 12145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:37.853765 12145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:37.855295 12145 catalog_manager.cc:1347] Generated new cluster ID: 1cd931a9e7ae4cf6ab13aa76d3766078
I20260809 03:23:37.855357 12145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 03:23:37 dist-test-slave-2w3w krb5kdc[12043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:37.861930 12137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:37.849841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58940 (local address 127.8.5.254:45943)
0809 03:23:37.850458 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:37.850468 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:37.850580 (+ 112us) server_negotiation.cc:407] Connection header received
0809 03:23:37.850722 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:37.850729 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:37.850780 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:37.851882 (+ 1102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:37.851999 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:37.853449 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:37.854515 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:37.855098 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:37.855211 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:37.857924 (+ 2713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:37.857928 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:37.857929 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:37.857940 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:37.860332 (+ 2392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:37.860703 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:37.860706 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:37.860706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:37.860820 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:37.861051 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:37.861052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:37.861052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:37.861358 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:37.861524 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:37.861593 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 03:23:37.861730 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":504,"threads_started":1}
I20260809 03:23:37.864043 12145 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:23:37.864748 12145 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:37.868810 12145 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c6eefdac4254152a09216b069ba8968: Generated new TSK 0
I20260809 03:23:37.868994 12145 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
I20260809 03:23:37.897480 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:45943
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:46841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:37.977463 12162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:37.977689 12162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:37.977731 12162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:37.978895 12162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:37.978957 12162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:37.979013 12162 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:23:37.980485 12162 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:46841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:45943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:37.980738 12162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:37.980974 12162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:37.985921 12167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:37.986261 12162 server_base.cc:1034] running on GCE node
W20260809 03:23:37.986061 12168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:37.986057 12170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:37.986539 12162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:37.986814 12162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:37.987977 12162 hybrid_clock.cc:648] HybridClock initialized: now 1786245817987953 us; error 41 us; skew 500 ppm
Aug 09 03:23:37 dist-test-slave-2w3w krb5kdc[12043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245817, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:37.990499 12162 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:23:37.991043 12162 webserver.cc:460] Webserver started at http://127.8.5.193:44931/ using document root <none> and password file <none>
I20260809 03:23:37.991267 12162 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:37.991334 12162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:37.991472 12162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:37.992470 12162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "64b3144017314db9a36289b42ef0043e"
format_stamp: "Formatted at 2026-08-09 03:23:37 on dist-test-slave-2w3w"
server_key: "5bf65d6dccdac4b89139c8fa52b41755"
server_key_iv: "b991642a10ecc174989253de8609e941"
server_key_version: "encryptionkey@0"
I20260809 03:23:37.992833 12162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "64b3144017314db9a36289b42ef0043e"
format_stamp: "Formatted at 2026-08-09 03:23:37 on dist-test-slave-2w3w"
server_key: "5bf65d6dccdac4b89139c8fa52b41755"
server_key_iv: "b991642a10ecc174989253de8609e941"
server_key_version: "encryptionkey@0"
I20260809 03:23:37.994160 12162 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:23:37.994913 12177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:37.995150 12162 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:37.995237 12162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "64b3144017314db9a36289b42ef0043e"
format_stamp: "Formatted at 2026-08-09 03:23:37 on dist-test-slave-2w3w"
server_key: "5bf65d6dccdac4b89139c8fa52b41755"
server_key_iv: "b991642a10ecc174989253de8609e941"
server_key_version: "encryptionkey@0"
I20260809 03:23:37.995290 12162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:38.024770 12162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:38.026551 12162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:38.026657 12162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:38.026845 12162 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:38.027182 12162 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:38.027216 12162 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:38.027240 12162 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:38.027287 12162 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:38.032740 12162 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:38343
I20260809 03:23:38.032823 12298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:38343 every 8 connection(s)
I20260809 03:23:38.033123 12162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
Aug 09 03:23:38 dist-test-slave-2w3w krb5kdc[12043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245817, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:38.042207 12137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:38.033937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:52661 (local address 127.8.5.254:45943)
0809 03:23:38.033980 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:38.033982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:38.034179 (+ 197us) server_negotiation.cc:407] Connection header received
0809 03:23:38.035108 (+ 929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:38.035109 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:38.035122 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:38.035178 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:38.035745 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:38.036348 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:38.037277 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:38.037473 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:38.037522 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:38.039695 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:38.039696 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:38.039696 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:38.039703 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:38.041134 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:38.041482 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:38.041483 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:38.041483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:38.041534 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:38.041733 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:38.041734 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:38.041734 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:38.041830 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:38.041881 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:38.042083 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 03:23:38.042144 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:23:38.042443 12301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:38.033872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:45943 (local address 127.8.5.193:52661)
0809 03:23:38.034050 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:38.034091 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:38.035017 (+ 926us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:38.035236 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:38.035239 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:38.035488 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:38.035673 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:38.035677 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:38.036416 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:38.036418 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:38.037202 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:38.037203 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:38.037545 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:38.037545 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:38.037642 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:38.038167 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:38.038175 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:38.039610 (+ 1435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:38.041204 (+ 1594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:38.041210 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:38.041211 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:38.041418 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:38.041588 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:38.041589 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:38.041589 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:38.041680 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:38.041883 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:38.041888 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:38.041992 (+ 104us) client_negotiation.cc:769] Sending connection context
0809 03:23:38.042071 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 03:23:38.042180 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":104,"threads_started":1}
I20260809 03:23:38.042609 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 12162
I20260809 03:23:38.042702 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:23:38.042906 8215 external_mini_cluster.cc:1428] Setting key 71dc7747e6f0ee92bb13e2d0789e3d7f
I20260809 03:23:38.043002 12299 heartbeater.cc:347] Connected to a master server at 127.8.5.254:45943
I20260809 03:23:38.043123 12299 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:38.043322 12299 heartbeater.cc:511] Master 127.8.5.254:45943 requested a full tablet report, sending...
I20260809 03:23:38.043919 12092 ts_manager.cc:194] Registered new tserver with Master: 64b3144017314db9a36289b42ef0043e (127.8.5.193:38343)
I20260809 03:23:38.044798 12092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:52661
WARNING: no policy specified for kudu/127.8.5.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
I20260809 03:23:38.067476 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:45943
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:46841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:38.147804 12304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:38.147993 12304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:38.148016 12304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:38.149142 12304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:38.149183 12304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:38.149235 12304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:23:38.150767 12304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:46841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:45943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:38.151047 12304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:38.151276 12304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:38.156288 12310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:38.156289 12313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:38.156319 12311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:38.156402 12304 server_base.cc:1034] running on GCE node
I20260809 03:23:38.156698 12304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:38.156891 12304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:38.158056 12304 hybrid_clock.cc:648] HybridClock initialized: now 1786245818158049 us; error 39 us; skew 500 ppm
Aug 09 03:23:38 dist-test-slave-2w3w krb5kdc[12043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245818, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:38.160517 12304 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:23:38.160918 12304 webserver.cc:460] Webserver started at http://127.8.5.194:43395/ using document root <none> and password file <none>
I20260809 03:23:38.161132 12304 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:38.161199 12304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:38.161355 12304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:38.162343 12304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "78ba45d1d775467a8355a0e6143daa5a"
format_stamp: "Formatted at 2026-08-09 03:23:38 on dist-test-slave-2w3w"
server_key: "2d84093cbd2f1b983802880c251dd6a8"
server_key_iv: "e16e2f21bc1f012f472cabfde96098ad"
server_key_version: "encryptionkey@0"
I20260809 03:23:38.162695 12304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "78ba45d1d775467a8355a0e6143daa5a"
format_stamp: "Formatted at 2026-08-09 03:23:38 on dist-test-slave-2w3w"
server_key: "2d84093cbd2f1b983802880c251dd6a8"
server_key_iv: "e16e2f21bc1f012f472cabfde96098ad"
server_key_version: "encryptionkey@0"
I20260809 03:23:38.164037 12304 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:23:38.164749 12322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:38.164934 12304 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:23:38.165030 12304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "78ba45d1d775467a8355a0e6143daa5a"
format_stamp: "Formatted at 2026-08-09 03:23:38 on dist-test-slave-2w3w"
server_key: "2d84093cbd2f1b983802880c251dd6a8"
server_key_iv: "e16e2f21bc1f012f472cabfde96098ad"
server_key_version: "encryptionkey@0"
I20260809 03:23:38.165112 12304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:38.209717 12304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:38.211658 12304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:38.211822 12304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:38.212061 12304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:38.212378 12304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:38.212411 12304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:38.212433 12304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:38.212446 12304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:38.218278 12304 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:42179
I20260809 03:23:38.218324 12441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:42179 every 8 connection(s)
I20260809 03:23:38.218628 12304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:23:38.222395 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 12304
I20260809 03:23:38.222496 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:23:38.222683 8215 external_mini_cluster.cc:1428] Setting key 07ae2316970531b21228a2260f37fc82
Aug 09 03:23:38 dist-test-slave-2w3w krb5kdc[12043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245818, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:38.228093 12137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:38.219332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:53689 (local address 127.8.5.254:45943)
0809 03:23:38.219395 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:38.219397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:38.219614 (+ 217us) server_negotiation.cc:407] Connection header received
0809 03:23:38.220468 (+ 854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:38.220469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:38.220478 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:38.220534 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:38.221067 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:38.221559 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:38.222668 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:38.222946 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:38.223053 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:38.225245 (+ 2192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:38.225246 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:38.225247 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:38.225254 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:38.226638 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:38.227124 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:38.227125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:38.227126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:38.227188 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:38.227448 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:38.227449 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:38.227449 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:38.227560 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:38.227632 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:38.227916 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 03:23:38.228003 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 03:23:38.228286 12444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:38.219317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:45943 (local address 127.8.5.194:53689)
0809 03:23:38.219478 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:38.219518 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:38.220384 (+ 866us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:38.220581 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:38.220584 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:38.220815 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:38.220997 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:38.221000 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:38.221634 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:38.221635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:38.222588 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:38.222591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:38.223071 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:38.223072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:38.223204 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:38.223642 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:38.223653 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:38.225140 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:38.226742 (+ 1602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:38.226749 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:38.226751 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:38.227029 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:38.227257 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:38.227258 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:38.227258 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:38.227373 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:38.227634 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:38.227641 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:38.227773 (+ 132us) client_negotiation.cc:769] Sending connection context
0809 03:23:38.227893 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 03:23:38.228044 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":92,"threads_started":1}
I20260809 03:23:38.228858 12442 heartbeater.cc:347] Connected to a master server at 127.8.5.254:45943
I20260809 03:23:38.228935 12442 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:38.229115 12442 heartbeater.cc:511] Master 127.8.5.254:45943 requested a full tablet report, sending...
I20260809 03:23:38.229490 12092 ts_manager.cc:194] Registered new tserver with Master: 78ba45d1d775467a8355a0e6143daa5a (127.8.5.194:42179)
I20260809 03:23:38.229875 12092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:53689
WARNING: no policy specified for kudu/127.8.5.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
I20260809 03:23:38.249084 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:45943
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:46841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:38.329236 12448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:38.329444 12448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:38.329466 12448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:38.330575 12448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:38.330616 12448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:38.330641 12448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:23:38.332151 12448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:46841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:45943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:38.332381 12448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:38.332594 12448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:38.337464 12453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:38.337630 12456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:38.337658 12454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:38.337718 12448 server_base.cc:1034] running on GCE node
I20260809 03:23:38.337934 12448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:38.338174 12448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:38.339314 12448 hybrid_clock.cc:648] HybridClock initialized: now 1786245818339299 us; error 27 us; skew 500 ppm
Aug 09 03:23:38 dist-test-slave-2w3w krb5kdc[12043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245818, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:38.341625 12448 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:23:38.342092 12448 webserver.cc:460] Webserver started at http://127.8.5.195:39667/ using document root <none> and password file <none>
I20260809 03:23:38.342306 12448 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:38.342371 12448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:38.342515 12448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:38.343639 12448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "c1f1d0b46cb8435bb62595ef6fd34cfe"
format_stamp: "Formatted at 2026-08-09 03:23:38 on dist-test-slave-2w3w"
server_key: "20024b5f9a56d09c76c5980706539b6b"
server_key_iv: "617cb421f568ccadc99a4604b329cf37"
server_key_version: "encryptionkey@0"
I20260809 03:23:38.344035 12448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "c1f1d0b46cb8435bb62595ef6fd34cfe"
format_stamp: "Formatted at 2026-08-09 03:23:38 on dist-test-slave-2w3w"
server_key: "20024b5f9a56d09c76c5980706539b6b"
server_key_iv: "617cb421f568ccadc99a4604b329cf37"
server_key_version: "encryptionkey@0"
I20260809 03:23:38.345342 12448 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:23:38.346076 12463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:38.346295 12448 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:38.346402 12448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "c1f1d0b46cb8435bb62595ef6fd34cfe"
format_stamp: "Formatted at 2026-08-09 03:23:38 on dist-test-slave-2w3w"
server_key: "20024b5f9a56d09c76c5980706539b6b"
server_key_iv: "617cb421f568ccadc99a4604b329cf37"
server_key_version: "encryptionkey@0"
I20260809 03:23:38.346479 12448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:38.359481 12448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:38.361183 12448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:38.361340 12448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:38.361552 12448 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:38.361838 12448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:38.361891 12448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:38.361931 12448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:38.361958 12448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:38.368348 12448 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:35615
I20260809 03:23:38.368392 12583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:35615 every 8 connection(s)
I20260809 03:23:38.368770 12448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:23:38.373646 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 12448
I20260809 03:23:38.373754 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:23:38.373940 8215 external_mini_cluster.cc:1428] Setting key 0a286175b07cfab65cefb22d2c79b141
Aug 09 03:23:38 dist-test-slave-2w3w krb5kdc[12043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245818, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:38.378509 12137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:38.369504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:52557 (local address 127.8.5.254:45943)
0809 03:23:38.369547 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:38.369549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:38.369764 (+ 215us) server_negotiation.cc:407] Connection header received
0809 03:23:38.370653 (+ 889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:38.370654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:38.370664 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:38.370714 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:38.371397 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:38.371931 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:38.372910 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:38.373095 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:38.373149 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:38.375771 (+ 2622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:38.375773 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:38.375773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:38.375782 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:38.377355 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:38.377703 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:38.377704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:38.377705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:38.377761 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:38.377988 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:38.377989 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:38.377989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:38.378094 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:38.378150 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:38.378377 (+ 227us) server_negotiation.cc:299] Negotiation successful
0809 03:23:38.378442 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:23:38.378649 12586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:38.369505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:45943 (local address 127.8.5.195:52557)
0809 03:23:38.369646 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:38.369678 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:38.370565 (+ 887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:38.370766 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:38.370769 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:38.371124 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:38.371316 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:38.371320 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:38.372019 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:38.372020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:38.372833 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:38.372835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:38.373181 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:38.373182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:38.373310 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:38.373926 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:38.373935 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:38.375677 (+ 1742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:38.377428 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:38.377433 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:38.377434 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:38.377636 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:38.377829 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:38.377830 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:38.377830 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:38.377930 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:38.378153 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:38.378157 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:38.378266 (+ 109us) client_negotiation.cc:769] Sending connection context
0809 03:23:38.378348 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 03:23:38.378464 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":84,"threads_started":1}
I20260809 03:23:38.379141 12584 heartbeater.cc:347] Connected to a master server at 127.8.5.254:45943
I20260809 03:23:38.379225 12584 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:38.379375 12584 heartbeater.cc:511] Master 127.8.5.254:45943 requested a full tablet report, sending...
I20260809 03:23:38.379738 12092 ts_manager.cc:194] Registered new tserver with Master: c1f1d0b46cb8435bb62595ef6fd34cfe (127.8.5.195:35615)
I20260809 03:23:38.380110 12092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:52557
I20260809 03:23:38.385869 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 03:23:38 dist-test-slave-2w3w krb5kdc[12043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 03:23:38 dist-test-slave-2w3w krb5kdc[12043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.193@KRBTEST.COM
I20260809 03:23:38.409722 12591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:38.401798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49488 (local address 127.8.5.193:38343)
0809 03:23:38.402003 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:38.402010 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:38.402024 (+ 14us) server_negotiation.cc:407] Connection header received
0809 03:23:38.402063 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:38.402065 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:38.402083 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:38.402157 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:38.402697 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:38.403584 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:38.404353 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:38.404695 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:38.404762 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:38.407116 (+ 2354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:38.407125 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:38.407125 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:38.407133 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:38.408634 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:38.408967 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:38.408970 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:38.408971 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:38.409027 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:38.409194 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:38.409195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:38.409195 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:38.409332 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:38.409434 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:38.409504 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 03:23:38.409569 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":130,"threads_started":1}
Aug 09 03:23:38 dist-test-slave-2w3w krb5kdc[12043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:38.417722 12137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:38.411171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39122 (local address 127.8.5.254:45943)
0809 03:23:38.411218 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:38.411222 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:38.411236 (+ 14us) server_negotiation.cc:407] Connection header received
0809 03:23:38.411289 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:38.411290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:38.411298 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:38.411338 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:38.411752 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:38.412208 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:38.412815 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:38.412996 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:38.413045 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:38.415148 (+ 2103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:38.415149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:38.415150 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:38.415156 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:38.416601 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:38.416937 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:38.416938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:38.416938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:38.416987 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:38.417200 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:38.417200 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:38.417201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:38.417373 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:38.417462 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:38.417571 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 03:23:38.417662 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260809 03:23:38.417985 12092 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39122
I20260809 03:23:38.418457 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 12162
I20260809 03:23:38.429663 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 12304
I20260809 03:23:38.435088 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 12448
I20260809 03:23:38.440680 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 12059
2026-08-09T03:23:38Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1917 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:23:38 dist-test-slave-2w3w krb5kdc[12596](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:23:38 dist-test-slave-2w3w krb5kdc[12596](info): set up 2 sockets
Aug 09 03:23:38 dist-test-slave-2w3w krb5kdc[12596](info): commencing operation
krb5kdc: starting...
W20260809 03:23:39.515668 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:23:39 dist-test-slave-2w3w krb5kdc[12596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:23:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:23:39.637414 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:37179
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:43045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:37179
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:39.718829 12611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:39.719075 12611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:39.719103 12611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:39.720268 12611 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:39.720317 12611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:39.720331 12611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:39.720345 12611 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:39.720391 12611 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:23:39.721854 12611 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:43045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:37179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:37179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:39.722095 12611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:39.722321 12611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:39.727227 12617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:39.727240 12619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:39.727248 12616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:39.727322 12611 server_base.cc:1034] running on GCE node
I20260809 03:23:39.727697 12611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:39.728058 12611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:39.729233 12611 hybrid_clock.cc:648] HybridClock initialized: now 1786245819729220 us; error 39 us; skew 500 ppm
Aug 09 03:23:39 dist-test-slave-2w3w krb5kdc[12596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245819, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:39.731781 12611 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:23:39.732157 12611 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:39.732229 12611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:39.732406 12611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:39.733479 12611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "a29bf56506ab46e183a60d467bdd0c09"
format_stamp: "Formatted at 2026-08-09 03:23:39 on dist-test-slave-2w3w"
server_key: "ab3663a80816e6d2985747064b71d5aa"
server_key_iv: "dbc325c3a9452f17d0b15043a97c876d"
server_key_version: "encryptionkey@0"
I20260809 03:23:39.733860 12611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "a29bf56506ab46e183a60d467bdd0c09"
format_stamp: "Formatted at 2026-08-09 03:23:39 on dist-test-slave-2w3w"
server_key: "ab3663a80816e6d2985747064b71d5aa"
server_key_iv: "dbc325c3a9452f17d0b15043a97c876d"
server_key_version: "encryptionkey@0"
I20260809 03:23:39.735193 12611 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:23:39.735888 12625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:39.736060 12611 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:39.736158 12611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "a29bf56506ab46e183a60d467bdd0c09"
format_stamp: "Formatted at 2026-08-09 03:23:39 on dist-test-slave-2w3w"
server_key: "ab3663a80816e6d2985747064b71d5aa"
server_key_iv: "dbc325c3a9452f17d0b15043a97c876d"
server_key_version: "encryptionkey@0"
I20260809 03:23:39.736239 12611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:39.761559 12611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:39.763971 12611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:39.764139 12611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:39.768508 12611 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:37179
I20260809 03:23:39.768539 12679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:37179 every 8 connection(s)
I20260809 03:23:39.768821 12611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:39.769858 12680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:39.772189 12680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09: Bootstrap starting.
I20260809 03:23:39.772310 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 12611
I20260809 03:23:39.772421 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:23:39.772599 8215 external_mini_cluster.cc:1428] Setting key 811c4982223cccf8b27d6d2c615bff80
I20260809 03:23:39.772954 12680 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:39.773296 12680 log.cc:824] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:39.774039 12680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09: No bootstrap required, opened a new log
I20260809 03:23:39.775982 12680 raft_consensus.cc:348] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a29bf56506ab46e183a60d467bdd0c09" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 37179 } }
I20260809 03:23:39.776135 12680 raft_consensus.cc:374] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:39.776185 12680 raft_consensus.cc:729] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bf56506ab46e183a60d467bdd0c09, State: Initialized, Role: FOLLOWER
I20260809 03:23:39.776360 12680 consensus_queue.cc:260] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a29bf56506ab46e183a60d467bdd0c09" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 37179 } }
I20260809 03:23:39.776455 12680 raft_consensus.cc:388] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:39.776500 12680 raft_consensus.cc:482] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:39.776551 12680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:39.777076 12680 raft_consensus.cc:504] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a29bf56506ab46e183a60d467bdd0c09" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 37179 } }
I20260809 03:23:39.777194 12680 leader_election.cc:302] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a29bf56506ab46e183a60d467bdd0c09; no voters:
I20260809 03:23:39.777379 12680 leader_election.cc:288] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:23:39.777432 12686 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:39.777622 12686 raft_consensus.cc:686] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09 [term 1 LEADER]: Becoming Leader. State: Replica: a29bf56506ab46e183a60d467bdd0c09, State: Running, Role: LEADER
I20260809 03:23:39.777670 12680 sys_catalog.cc:564] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:39.777726 12686 consensus_queue.cc:237] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a29bf56506ab46e183a60d467bdd0c09" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 37179 } }
I20260809 03:23:39.778023 12686 sys_catalog.cc:455] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a29bf56506ab46e183a60d467bdd0c09. Latest consensus state: current_term: 1 leader_uuid: "a29bf56506ab46e183a60d467bdd0c09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a29bf56506ab46e183a60d467bdd0c09" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 37179 } } }
I20260809 03:23:39.778034 12687 sys_catalog.cc:455] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a29bf56506ab46e183a60d467bdd0c09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a29bf56506ab46e183a60d467bdd0c09" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 37179 } } }
I20260809 03:23:39.778123 12686 sys_catalog.cc:458] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:39.778127 12687 sys_catalog.cc:458] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:39.779258 12694 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 09 03:23:39 dist-test-slave-2w3w krb5kdc[12596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:39.779939 12694 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:39.781423 12694 catalog_manager.cc:1347] Generated new cluster ID: 802558c3866749aab975aae2a3f29636
I20260809 03:23:39.781477 12694 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:23:39.783878 12684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:39.773099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34840 (local address 127.8.5.254:37179)
0809 03:23:39.773304 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:39.773314 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:39.773348 (+ 34us) server_negotiation.cc:407] Connection header received
0809 03:23:39.773979 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:39.773987 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:39.774036 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:39.774213 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:39.774875 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:39.775795 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:39.776778 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:39.777205 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:39.777315 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:39.780246 (+ 2931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:39.780250 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:39.780250 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:39.780262 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:39.782247 (+ 1985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:39.782662 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:39.782664 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:39.782665 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:39.782760 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:39.783014 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:39.783015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:39.783015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:39.783290 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:39.783442 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:39.783560 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 03:23:39.783683 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":81,"threads_started":1}
I20260809 03:23:39.789270 12694 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:23:39.789783 12694 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:39.795320 12694 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09: Generated new TSK 0
I20260809 03:23:39.795480 12694 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
I20260809 03:23:39.825344 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:37179
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:43045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:39.907025 12710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:39.907224 12710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:39.907248 12710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:39.908347 12710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:39.908380 12710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:39.908406 12710 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:23:39.909933 12710 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:43045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:37179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:39.910115 12710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:39.910285 12710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:39.915077 12716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:39.915177 12710 server_base.cc:1034] running on GCE node
W20260809 03:23:39.915102 12715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:39.915102 12718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:39.915508 12710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:39.915745 12710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:39.916916 12710 hybrid_clock.cc:648] HybridClock initialized: now 1786245819916896 us; error 37 us; skew 500 ppm
Aug 09 03:23:39 dist-test-slave-2w3w krb5kdc[12596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245819, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:39.919533 12710 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:23:39.919924 12710 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:39.919994 12710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:39.920133 12710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:39.921164 12710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "4ea704fbc29a4e63bd593967dde36a7e"
format_stamp: "Formatted at 2026-08-09 03:23:39 on dist-test-slave-2w3w"
server_key: "0012a49bfa8c183f7b2083937e1cd48e"
server_key_iv: "6c862ac6c4b4c8d7cb0f61974691c23b"
server_key_version: "encryptionkey@0"
I20260809 03:23:39.921520 12710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "4ea704fbc29a4e63bd593967dde36a7e"
format_stamp: "Formatted at 2026-08-09 03:23:39 on dist-test-slave-2w3w"
server_key: "0012a49bfa8c183f7b2083937e1cd48e"
server_key_iv: "6c862ac6c4b4c8d7cb0f61974691c23b"
server_key_version: "encryptionkey@0"
I20260809 03:23:39.922781 12710 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 03:23:39.923592 12725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:39.923786 12710 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:39.923884 12710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "4ea704fbc29a4e63bd593967dde36a7e"
format_stamp: "Formatted at 2026-08-09 03:23:39 on dist-test-slave-2w3w"
server_key: "0012a49bfa8c183f7b2083937e1cd48e"
server_key_iv: "6c862ac6c4b4c8d7cb0f61974691c23b"
server_key_version: "encryptionkey@0"
I20260809 03:23:39.923972 12710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:39.937465 12710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:39.939450 12710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:39.939616 12710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:39.939884 12710 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:39.940238 12710 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:39.940294 12710 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:39.940336 12710 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:39.940373 12710 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:39.946108 12710 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:46755
I20260809 03:23:39.946156 12848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:46755 every 8 connection(s)
I20260809 03:23:39.946416 12710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:23:39.950264 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 12710
I20260809 03:23:39.950373 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:23:39.950544 8215 external_mini_cluster.cc:1428] Setting key 2a388eb1d0a63215510aa9b95436fea4
Aug 09 03:23:39 dist-test-slave-2w3w krb5kdc[12596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245819, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:39.956372 12684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:39.947063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:44965 (local address 127.8.5.254:37179)
0809 03:23:39.947122 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:39.947124 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:39.947398 (+ 274us) server_negotiation.cc:407] Connection header received
0809 03:23:39.947919 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:39.947920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:39.947934 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:39.947987 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:39.948999 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:39.949537 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:39.950626 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:39.950905 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:39.951009 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:39.953442 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:39.953443 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:39.953443 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:39.953450 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:39.954782 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:39.955378 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:39.955380 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:39.955380 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:39.955443 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:39.955737 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:39.955737 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:39.955737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:39.955842 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:39.955896 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:39.956230 (+ 334us) server_negotiation.cc:299] Negotiation successful
0809 03:23:39.956300 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:23:39.956744 12851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:39.947085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:37179 (local address 127.8.5.193:44965)
0809 03:23:39.947250 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:39.947312 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:39.947808 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:39.948053 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:39.948057 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:39.948314 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:39.948893 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:39.948899 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:39.949641 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:39.949643 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:39.950527 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:39.950530 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:39.951018 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:39.951019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:39.951184 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:39.951735 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:39.951748 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:39.953348 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:39.954878 (+ 1530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:39.954887 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:39.954889 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:39.955288 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:39.955520 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:39.955521 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:39.955521 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:39.955669 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:39.955912 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:39.955918 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:39.956091 (+ 173us) client_negotiation.cc:769] Sending connection context
0809 03:23:39.956214 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 03:23:39.956400 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":66,"threads_started":1}
I20260809 03:23:39.957305 12849 heartbeater.cc:347] Connected to a master server at 127.8.5.254:37179
I20260809 03:23:39.957413 12849 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:39.957582 12849 heartbeater.cc:511] Master 127.8.5.254:37179 requested a full tablet report, sending...
I20260809 03:23:39.958061 12642 ts_manager.cc:194] Registered new tserver with Master: 4ea704fbc29a4e63bd593967dde36a7e (127.8.5.193:46755)
I20260809 03:23:39.958664 12642 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:44965
WARNING: no policy specified for kudu/127.8.5.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
I20260809 03:23:39.976064 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:37179
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:43045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:40.056191 12854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:40.056375 12854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:40.056398 12854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:40.057415 12854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:40.057446 12854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:40.057471 12854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:23:40.058797 12854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:43045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:37179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:40.058990 12854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:40.059149 12854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:40.063823 12862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:40.063834 12859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:40.063834 12860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:40.064172 12854 server_base.cc:1034] running on GCE node
I20260809 03:23:40.064363 12854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:40.064555 12854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:40.065687 12854 hybrid_clock.cc:648] HybridClock initialized: now 1786245820065677 us; error 26 us; skew 500 ppm
Aug 09 03:23:40 dist-test-slave-2w3w krb5kdc[12596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245820, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:40.068241 12854 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:23:40.068572 12854 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:40.068617 12854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:40.068699 12854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:40.069644 12854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "21b711a6ecfb4a88bbee12986ba4671f"
format_stamp: "Formatted at 2026-08-09 03:23:40 on dist-test-slave-2w3w"
server_key: "7ac28cd312bcb7435d20eadc0201f61f"
server_key_iv: "fc1eeb378694d1d30991b89593adabff"
server_key_version: "encryptionkey@0"
I20260809 03:23:40.069944 12854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "21b711a6ecfb4a88bbee12986ba4671f"
format_stamp: "Formatted at 2026-08-09 03:23:40 on dist-test-slave-2w3w"
server_key: "7ac28cd312bcb7435d20eadc0201f61f"
server_key_iv: "fc1eeb378694d1d30991b89593adabff"
server_key_version: "encryptionkey@0"
I20260809 03:23:40.071146 12854 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:23:40.071774 12868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:40.071942 12854 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:40.072042 12854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "21b711a6ecfb4a88bbee12986ba4671f"
format_stamp: "Formatted at 2026-08-09 03:23:40 on dist-test-slave-2w3w"
server_key: "7ac28cd312bcb7435d20eadc0201f61f"
server_key_iv: "fc1eeb378694d1d30991b89593adabff"
server_key_version: "encryptionkey@0"
I20260809 03:23:40.072119 12854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:40.091555 12854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:40.093739 12854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:40.093916 12854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:40.094152 12854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:40.094447 12854 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:40.094501 12854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:40.094547 12854 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:40.094594 12854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:40.100256 12854 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:41771
I20260809 03:23:40.100302 12990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:41771 every 8 connection(s)
I20260809 03:23:40.100540 12854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:23:40.100914 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 12854
I20260809 03:23:40.101016 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:23:40.101212 8215 external_mini_cluster.cc:1428] Setting key 50e8a6f938969d69770ac0f6282bdc35
Aug 09 03:23:40 dist-test-slave-2w3w krb5kdc[12596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245820, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.5.195@KRBTEST.COM; defaulting to no policy
I20260809 03:23:40.111490 12684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.101868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:54361 (local address 127.8.5.254:37179)
0809 03:23:40.101919 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:40.101921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:40.102149 (+ 228us) server_negotiation.cc:407] Connection header received
0809 03:23:40.102650 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:40.102651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:40.102663 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:40.102726 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:40.103843 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.104340 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.105854 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.106036 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.106084 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:40.108484 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:40.108485 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:40.108486 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:40.108493 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:40.109910 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:40.110395 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:40.110397 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:40.110397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:40.110465 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:40.110741 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:40.110742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:40.110742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:40.110874 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:40.110950 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:40.111309 (+ 359us) server_negotiation.cc:299] Negotiation successful
0809 03:23:40.111399 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 03:23:40.111670 12993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.101865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:37179 (local address 127.8.5.194:54361)
0809 03:23:40.102031 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:40.102065 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:40.102544 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:40.102796 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:40.102800 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:40.103153 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:40.103726 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:40.103734 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.104429 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.104430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:40.105765 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:40.105768 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.106122 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.106123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:40.106275 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:40.106781 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:40.106791 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:40.108384 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:40.110015 (+ 1631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:40.110022 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:40.110024 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:40.110294 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:40.110535 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:40.110536 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:40.110536 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:40.110650 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:40.110942 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:40.110948 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:40.111168 (+ 220us) client_negotiation.cc:769] Sending connection context
0809 03:23:40.111283 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 03:23:40.111442 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":82,"threads_started":1}
I20260809 03:23:40.112195 12991 heartbeater.cc:347] Connected to a master server at 127.8.5.254:37179
I20260809 03:23:40.112278 12991 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:40.112440 12991 heartbeater.cc:511] Master 127.8.5.254:37179 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.195@KRBTEST.COM" created.
I20260809 03:23:40.112805 12642 ts_manager.cc:194] Registered new tserver with Master: 21b711a6ecfb4a88bbee12986ba4671f (127.8.5.194:41771)
I20260809 03:23:40.113265 12642 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:54361
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
I20260809 03:23:40.126749 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:37179
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:43045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:40.207710 12996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:40.207912 12996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:40.207949 12996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:40.209043 12996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:40.209120 12996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:40.209161 12996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:23:40.210577 12996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:43045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:37179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12996
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:40.210824 12996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:40.211072 12996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:40.215703 13004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:40.215796 13001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:40.215715 13002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:40.215883 12996 server_base.cc:1034] running on GCE node
I20260809 03:23:40.216100 12996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:40.216279 12996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:40.217422 12996 hybrid_clock.cc:648] HybridClock initialized: now 1786245820217394 us; error 50 us; skew 500 ppm
Aug 09 03:23:40 dist-test-slave-2w3w krb5kdc[12596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245820, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:40.219884 12996 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:23:40.220256 12996 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:40.220327 12996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:40.220474 12996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:40.221453 12996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "5813945231a14eb581135a819c8fe4ed"
format_stamp: "Formatted at 2026-08-09 03:23:40 on dist-test-slave-2w3w"
server_key: "9058c04a11e2cf6db3deadabb26ea30a"
server_key_iv: "89ad5488e4da4a3e1210a952be768d0f"
server_key_version: "encryptionkey@0"
I20260809 03:23:40.221799 12996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "5813945231a14eb581135a819c8fe4ed"
format_stamp: "Formatted at 2026-08-09 03:23:40 on dist-test-slave-2w3w"
server_key: "9058c04a11e2cf6db3deadabb26ea30a"
server_key_iv: "89ad5488e4da4a3e1210a952be768d0f"
server_key_version: "encryptionkey@0"
I20260809 03:23:40.223152 12996 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:23:40.223879 13010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:40.224053 12996 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:40.224159 12996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "5813945231a14eb581135a819c8fe4ed"
format_stamp: "Formatted at 2026-08-09 03:23:40 on dist-test-slave-2w3w"
server_key: "9058c04a11e2cf6db3deadabb26ea30a"
server_key_iv: "89ad5488e4da4a3e1210a952be768d0f"
server_key_version: "encryptionkey@0"
I20260809 03:23:40.224247 12996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:40.237795 12996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:40.239816 12996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:40.239976 12996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:40.240190 12996 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:40.240489 12996 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:40.240541 12996 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:40.240574 12996 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:40.240600 12996 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:40.246403 12996 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:44949
I20260809 03:23:40.246448 13129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:44949 every 8 connection(s)
I20260809 03:23:40.246688 12996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:23:40.251295 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 12996
I20260809 03:23:40.251412 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:23:40.251622 8215 external_mini_cluster.cc:1428] Setting key ba72ea603bc8e54799f4878198448920
Aug 09 03:23:40 dist-test-slave-2w3w krb5kdc[12596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245820, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:40.255609 12684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.247411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:51343 (local address 127.8.5.254:37179)
0809 03:23:40.247474 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:40.247476 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:40.247661 (+ 185us) server_negotiation.cc:407] Connection header received
0809 03:23:40.248106 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:40.248107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:40.248116 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:40.248173 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:40.249023 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.249538 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.250548 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.250729 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.250780 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:40.253180 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:40.253181 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:40.253181 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:40.253188 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:40.254370 (+ 1182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:40.254730 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:40.254731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:40.254731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:40.254808 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:40.255104 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:40.255104 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:40.255104 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:40.255204 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:40.255257 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:40.255481 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 03:23:40.255545 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 03:23:40.255800 13132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.247391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:37179 (local address 127.8.5.195:51343)
0809 03:23:40.247537 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:40.247576 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:40.248024 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:40.248220 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:40.248223 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:40.248471 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:40.248949 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:40.248953 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.249622 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.249622 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:40.250467 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:40.250469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.250801 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.250801 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:40.250896 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:40.251413 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:40.251423 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:40.253099 (+ 1676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:40.254445 (+ 1346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:40.254451 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:40.254453 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:40.254667 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:40.254876 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:40.254876 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:40.254876 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:40.255040 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:40.255264 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:40.255268 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:40.255374 (+ 106us) client_negotiation.cc:769] Sending connection context
0809 03:23:40.255453 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 03:23:40.255562 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":79,"threads_started":1}
I20260809 03:23:40.256323 13130 heartbeater.cc:347] Connected to a master server at 127.8.5.254:37179
I20260809 03:23:40.256428 13130 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:40.256570 13130 heartbeater.cc:511] Master 127.8.5.254:37179 requested a full tablet report, sending...
I20260809 03:23:40.256950 12642 ts_manager.cc:194] Registered new tserver with Master: 5813945231a14eb581135a819c8fe4ed (127.8.5.195:44949)
I20260809 03:23:40.257316 12642 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:51343
I20260809 03:23:40.263302 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:23:40.270617 12684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.264635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34856 (local address 127.8.5.254:37179)
0809 03:23:40.264736 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:40.264738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:40.264873 (+ 135us) server_negotiation.cc:407] Connection header received
0809 03:23:40.264968 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:40.264969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:40.264979 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:40.265025 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:40.265578 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.266056 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.266815 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.267110 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.267179 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:40.268328 (+ 1149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:40.268329 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:40.268330 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:40.268337 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:40.269472 (+ 1135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:40.269813 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:40.269814 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:40.269815 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:40.269868 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:40.270086 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:40.270087 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:40.270087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:40.270230 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:40.270343 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:40.270445 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 03:23:40.270521 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 03:23:40.272014 12642 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34856:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:23:40.273590 12642 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:23:40.280113 13144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.275942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36160 (local address 127.8.5.194:41771)
0809 03:23:40.276152 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:40.276157 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:40.276200 (+ 43us) server_negotiation.cc:407] Connection header received
0809 03:23:40.276297 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:40.276299 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:40.276314 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:40.276385 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:40.276612 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.277699 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.279040 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.279705 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.279801 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:40.279870 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:40.279995 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 03:23:40.280030 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":108,"threads_started":1}
I20260809 03:23:40.280102 13138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.275717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:41771 (local address 127.0.0.1:36160)
0809 03:23:40.276134 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:40.276144 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:40.276214 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:40.276479 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:40.276480 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:40.276482 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:40.276531 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:40.276533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.277817 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.277818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:40.278953 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:40.278955 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.279806 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.279807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:40.279890 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:40.279903 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 03:23:40.279975 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 03:23:40.280031 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":401,"mutex_wait_us":26,"thread_start_us":55,"threads_started":1}
I20260809 03:23:40.280308 13143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.275900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57064 (local address 127.8.5.193:46755)
0809 03:23:40.276093 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:40.276097 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:40.276109 (+ 12us) server_negotiation.cc:407] Connection header received
0809 03:23:40.276222 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:40.276225 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:40.276252 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:40.276499 (+ 247us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:40.276585 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.277732 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.279027 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.279770 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.279842 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:40.279895 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:40.280145 (+ 250us) server_negotiation.cc:299] Negotiation successful
0809 03:23:40.280188 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":96,"threads_started":1}
I20260809 03:23:40.280339 13140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.275717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:44949 (local address 127.0.0.1:40160)
0809 03:23:40.276171 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:40.276180 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:40.276226 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:40.276505 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:40.276506 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:40.276508 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:40.276560 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:40.276562 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.277472 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.277473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:40.278889 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:40.278892 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.279937 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.279938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:40.280004 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:40.280010 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 03:23:40.280058 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 03:23:40.280100 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"mutex_wait_us":4,"thread_start_us":97,"threads_started":1}
I20260809 03:23:40.280463 13142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.275884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40160 (local address 127.8.5.195:44949)
0809 03:23:40.276084 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:40.276089 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:40.276284 (+ 195us) server_negotiation.cc:407] Connection header received
0809 03:23:40.276328 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:40.276330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:40.276353 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:40.276426 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:40.276635 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.277352 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.279006 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.279783 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.279842 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:40.279896 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:40.280145 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 03:23:40.280309 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":113,"threads_started":1}
I20260809 03:23:40.280575 13139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.275714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:46755 (local address 127.0.0.1:57064)
0809 03:23:40.275966 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:40.276033 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:40.276095 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:40.276332 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:40.276335 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:40.276337 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:40.276402 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:40.276403 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.277834 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.277836 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:40.278896 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:40.278917 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.279935 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.279937 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:40.280004 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:40.280008 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:23:40.280058 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 03:23:40.280100 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":22,"thread_start_us":59,"threads_started":1}
I20260809 03:23:40.280946 12921 tablet_service.cc:1467] Processing CreateTablet for tablet 7d7d7de6ec3d4c71b0d0dd832d96f169 (DEFAULT_TABLE table=test-table [id=fae6df5f5a0945979b7b8a5a7d7399a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:40.281239 12921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d7d7de6ec3d4c71b0d0dd832d96f169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:40.283344 12777 tablet_service.cc:1467] Processing CreateTablet for tablet 7d7d7de6ec3d4c71b0d0dd832d96f169 (DEFAULT_TABLE table=test-table [id=fae6df5f5a0945979b7b8a5a7d7399a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:40.283725 12777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d7d7de6ec3d4c71b0d0dd832d96f169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:40.283937 13145 tablet_bootstrap.cc:492] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f: Bootstrap starting.
I20260809 03:23:40.284641 13145 tablet_bootstrap.cc:654] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:40.285354 13145 log.cc:824] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:40.286136 13145 tablet_bootstrap.cc:492] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f: No bootstrap required, opened a new log
I20260809 03:23:40.286217 13145 ts_tablet_manager.cc:1397] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:23:40.287570 13062 tablet_service.cc:1467] Processing CreateTablet for tablet 7d7d7de6ec3d4c71b0d0dd832d96f169 (DEFAULT_TABLE table=test-table [id=fae6df5f5a0945979b7b8a5a7d7399a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:40.287890 13062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d7d7de6ec3d4c71b0d0dd832d96f169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:40.288204 13145 raft_consensus.cc:348] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5813945231a14eb581135a819c8fe4ed" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44949 } } peers { permanent_uuid: "4ea704fbc29a4e63bd593967dde36a7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46755 } } peers { permanent_uuid: "21b711a6ecfb4a88bbee12986ba4671f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41771 } }
I20260809 03:23:40.288367 13145 raft_consensus.cc:374] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:40.288414 13145 raft_consensus.cc:729] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b711a6ecfb4a88bbee12986ba4671f, State: Initialized, Role: FOLLOWER
I20260809 03:23:40.288535 13145 consensus_queue.cc:260] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5813945231a14eb581135a819c8fe4ed" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44949 } } peers { permanent_uuid: "4ea704fbc29a4e63bd593967dde36a7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46755 } } peers { permanent_uuid: "21b711a6ecfb4a88bbee12986ba4671f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41771 } }
I20260809 03:23:40.288872 13145 ts_tablet_manager.cc:1428] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 03:23:40.288921 12991 heartbeater.cc:503] Master 127.8.5.254:37179 was elected leader, sending a full tablet report...
I20260809 03:23:40.289076 13147 tablet_bootstrap.cc:492] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e: Bootstrap starting.
I20260809 03:23:40.289712 13147 tablet_bootstrap.cc:654] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:40.290342 13147 log.cc:824] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:40.290879 13150 tablet_bootstrap.cc:492] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed: Bootstrap starting.
I20260809 03:23:40.291111 13147 tablet_bootstrap.cc:492] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e: No bootstrap required, opened a new log
I20260809 03:23:40.291185 13147 ts_tablet_manager.cc:1397] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:23:40.291512 13150 tablet_bootstrap.cc:654] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:40.292004 13150 log.cc:824] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:40.292785 13150 tablet_bootstrap.cc:492] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed: No bootstrap required, opened a new log
I20260809 03:23:40.292866 13150 ts_tablet_manager.cc:1397] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:23:40.292825 13147 raft_consensus.cc:348] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5813945231a14eb581135a819c8fe4ed" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44949 } } peers { permanent_uuid: "4ea704fbc29a4e63bd593967dde36a7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46755 } } peers { permanent_uuid: "21b711a6ecfb4a88bbee12986ba4671f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41771 } }
I20260809 03:23:40.292999 13147 raft_consensus.cc:374] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:40.293053 13147 raft_consensus.cc:729] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ea704fbc29a4e63bd593967dde36a7e, State: Initialized, Role: FOLLOWER
I20260809 03:23:40.293169 13147 consensus_queue.cc:260] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5813945231a14eb581135a819c8fe4ed" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44949 } } peers { permanent_uuid: "4ea704fbc29a4e63bd593967dde36a7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46755 } } peers { permanent_uuid: "21b711a6ecfb4a88bbee12986ba4671f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41771 } }
I20260809 03:23:40.293443 13147 ts_tablet_manager.cc:1428] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:23:40.293509 12849 heartbeater.cc:503] Master 127.8.5.254:37179 was elected leader, sending a full tablet report...
I20260809 03:23:40.294757 13150 raft_consensus.cc:348] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5813945231a14eb581135a819c8fe4ed" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44949 } } peers { permanent_uuid: "4ea704fbc29a4e63bd593967dde36a7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46755 } } peers { permanent_uuid: "21b711a6ecfb4a88bbee12986ba4671f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41771 } }
I20260809 03:23:40.294894 13150 raft_consensus.cc:374] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:40.294940 13150 raft_consensus.cc:729] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5813945231a14eb581135a819c8fe4ed, State: Initialized, Role: FOLLOWER
I20260809 03:23:40.295075 13150 consensus_queue.cc:260] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5813945231a14eb581135a819c8fe4ed" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44949 } } peers { permanent_uuid: "4ea704fbc29a4e63bd593967dde36a7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46755 } } peers { permanent_uuid: "21b711a6ecfb4a88bbee12986ba4671f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41771 } }
I20260809 03:23:40.295357 13150 ts_tablet_manager.cc:1428] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260809 03:23:40.295357 13130 heartbeater.cc:503] Master 127.8.5.254:37179 was elected leader, sending a full tablet report...
I20260809 03:23:40.337896 13152 raft_consensus.cc:482] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:23:40.338030 13152 raft_consensus.cc:504] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5813945231a14eb581135a819c8fe4ed" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44949 } } peers { permanent_uuid: "4ea704fbc29a4e63bd593967dde36a7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46755 } } peers { permanent_uuid: "21b711a6ecfb4a88bbee12986ba4671f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41771 } }
I20260809 03:23:40.338344 13152 leader_election.cc:288] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5813945231a14eb581135a819c8fe4ed (127.8.5.195:44949), 21b711a6ecfb4a88bbee12986ba4671f (127.8.5.194:41771)
I20260809 03:23:40.341274 12851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.338511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:44949 (local address 127.8.5.193:44769)
0809 03:23:40.338576 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:40.338590 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:40.338663 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:40.338804 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:40.338805 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:40.338807 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:40.338884 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:40.338886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.339610 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.339611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:40.340444 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:40.340447 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.341005 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.341006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:40.341082 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:40.341085 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:23:40.341148 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 03:23:40.341183 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 03:23:40.341274 13142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.338599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:44769 (local address 127.8.5.195:44949)
0809 03:23:40.338678 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:40.338680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:40.338688 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:23:40.338716 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:40.338717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:40.338745 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:40.338793 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:40.338984 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.339541 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.340531 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.340923 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.341004 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:40.341014 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:40.341153 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 03:23:40.341192 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 03:23:40.341434 13154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.338511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:41771 (local address 127.8.5.193:58409)
0809 03:23:40.338781 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:40.338790 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:40.338883 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:40.339065 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:40.339066 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:40.339068 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:40.339170 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:40.339171 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.339844 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.339845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:40.340579 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:40.340581 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.341133 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.341134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:40.341229 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:40.341235 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 03:23:40.341305 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 03:23:40.341350 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":61,"thread_start_us":131,"threads_started":1}
I20260809 03:23:40.341419 13144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.338610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:58409 (local address 127.8.5.194:41771)
0809 03:23:40.338677 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:40.338679 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:40.338871 (+ 192us) server_negotiation.cc:407] Connection header received
0809 03:23:40.338939 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:40.338940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:40.338951 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:40.339051 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:40.339238 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.339739 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.340672 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.341047 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.341130 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:40.341139 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:40.341312 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 03:23:40.341353 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 03:23:40.341857 12941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d7d7de6ec3d4c71b0d0dd832d96f169" candidate_uuid: "4ea704fbc29a4e63bd593967dde36a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b711a6ecfb4a88bbee12986ba4671f" is_pre_election: true
I20260809 03:23:40.341853 13082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d7d7de6ec3d4c71b0d0dd832d96f169" candidate_uuid: "4ea704fbc29a4e63bd593967dde36a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5813945231a14eb581135a819c8fe4ed" is_pre_election: true
I20260809 03:23:40.342007 13082 raft_consensus.cc:2454] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ea704fbc29a4e63bd593967dde36a7e in term 0.
I20260809 03:23:40.342007 12941 raft_consensus.cc:2454] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ea704fbc29a4e63bd593967dde36a7e in term 0.
I20260809 03:23:40.342221 12730 leader_election.cc:302] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b711a6ecfb4a88bbee12986ba4671f, 4ea704fbc29a4e63bd593967dde36a7e; no voters:
I20260809 03:23:40.342336 13152 raft_consensus.cc:2781] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:23:40.342392 13152 raft_consensus.cc:482] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:23:40.342427 13152 raft_consensus.cc:3037] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:40.343163 13152 raft_consensus.cc:504] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5813945231a14eb581135a819c8fe4ed" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44949 } } peers { permanent_uuid: "4ea704fbc29a4e63bd593967dde36a7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46755 } } peers { permanent_uuid: "21b711a6ecfb4a88bbee12986ba4671f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41771 } }
I20260809 03:23:40.343320 13152 leader_election.cc:288] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [CANDIDATE]: Term 1 election: Requested vote from peers 5813945231a14eb581135a819c8fe4ed (127.8.5.195:44949), 21b711a6ecfb4a88bbee12986ba4671f (127.8.5.194:41771)
I20260809 03:23:40.343493 13082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d7d7de6ec3d4c71b0d0dd832d96f169" candidate_uuid: "4ea704fbc29a4e63bd593967dde36a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5813945231a14eb581135a819c8fe4ed"
I20260809 03:23:40.343477 12941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d7d7de6ec3d4c71b0d0dd832d96f169" candidate_uuid: "4ea704fbc29a4e63bd593967dde36a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b711a6ecfb4a88bbee12986ba4671f"
I20260809 03:23:40.343581 13082 raft_consensus.cc:3037] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:40.343580 12941 raft_consensus.cc:3037] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:40.344323 13082 raft_consensus.cc:2454] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ea704fbc29a4e63bd593967dde36a7e in term 1.
I20260809 03:23:40.344321 12941 raft_consensus.cc:2454] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ea704fbc29a4e63bd593967dde36a7e in term 1.
I20260809 03:23:40.344533 12730 leader_election.cc:302] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b711a6ecfb4a88bbee12986ba4671f, 4ea704fbc29a4e63bd593967dde36a7e; no voters:
I20260809 03:23:40.344637 13152 raft_consensus.cc:2781] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:40.344822 13152 raft_consensus.cc:686] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [term 1 LEADER]: Becoming Leader. State: Replica: 4ea704fbc29a4e63bd593967dde36a7e, State: Running, Role: LEADER
I20260809 03:23:40.344920 13152 consensus_queue.cc:237] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5813945231a14eb581135a819c8fe4ed" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44949 } } peers { permanent_uuid: "4ea704fbc29a4e63bd593967dde36a7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46755 } } peers { permanent_uuid: "21b711a6ecfb4a88bbee12986ba4671f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41771 } }
I20260809 03:23:40.345669 12642 catalog_manager.cc:5495] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ea704fbc29a4e63bd593967dde36a7e (127.8.5.193). New cstate: current_term: 1 leader_uuid: "4ea704fbc29a4e63bd593967dde36a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5813945231a14eb581135a819c8fe4ed" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ea704fbc29a4e63bd593967dde36a7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b711a6ecfb4a88bbee12986ba4671f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41771 } health_report { overall_health: UNKNOWN } } }
W20260809 03:23:40.351096 12992 tablet.cc:2369] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:23:40.351883 13143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.349574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57076 (local address 127.8.5.193:46755)
0809 03:23:40.349633 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:40.349634 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:40.349642 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:23:40.349701 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:40.349702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:40.349715 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:40.349772 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:40.349900 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.350310 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.351061 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:40.351330 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:40.351392 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:40.351531 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:40.351616 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:40.351675 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:40.351770 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 03:23:40.351786 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 03:23:40.353500 12941 raft_consensus.cc:1261] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f [term 1 FOLLOWER]: Refusing update from remote peer 4ea704fbc29a4e63bd593967dde36a7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:40.353519 13082 raft_consensus.cc:1261] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed [term 1 FOLLOWER]: Refusing update from remote peer 4ea704fbc29a4e63bd593967dde36a7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:40.353803 13152 consensus_queue.cc:1035] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b711a6ecfb4a88bbee12986ba4671f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:40.353964 13155 consensus_queue.cc:1035] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5813945231a14eb581135a819c8fe4ed" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:40.358421 12642 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:40.358516 12642 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:40.359305 12642 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a29bf56506ab46e183a60d467bdd0c09: Sending DeleteTablet for 3 replicas of tablet 7d7d7de6ec3d4c71b0d0dd832d96f169
I20260809 03:23:40.359630 13062 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d7d7de6ec3d4c71b0d0dd832d96f169 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:40 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:40160
I20260809 03:23:40.359651 12777 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d7d7de6ec3d4c71b0d0dd832d96f169 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:40 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:57064
I20260809 03:23:40.359648 12921 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d7d7de6ec3d4c71b0d0dd832d96f169 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:40 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:36160
I20260809 03:23:40.359903 13169 tablet_replica.cc:330] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed: stopping tablet replica
I20260809 03:23:40.359941 13170 tablet_replica.cc:330] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f: stopping tablet replica
I20260809 03:23:40.360074 13168 tablet_replica.cc:330] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e: stopping tablet replica
I20260809 03:23:40.360167 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 12710
I20260809 03:23:40.360195 13168 raft_consensus.cc:2229] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 4ea704fbc29a4e63bd593967dde36a7e [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:23:40.360795 13169 raft_consensus.cc:2229] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:40.360898 13169 raft_consensus.cc:2258] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:40.362001 13169 ts_tablet_manager.cc:1905] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:40.364382 13169 ts_tablet_manager.cc:1918] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:23:40.364482 13169 log.cc:1196] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/7d7d7de6ec3d4c71b0d0dd832d96f169
I20260809 03:23:40.364861 13169 ts_tablet_manager.cc:1939] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 5813945231a14eb581135a819c8fe4ed: Deleting consensus metadata
I20260809 03:23:40.365367 12627 catalog_manager.cc:4841] TS 5813945231a14eb581135a819c8fe4ed (127.8.5.195:44949): tablet 7d7d7de6ec3d4c71b0d0dd832d96f169 (table test-table [id=fae6df5f5a0945979b7b8a5a7d7399a0]) successfully deleted
I20260809 03:23:40.366521 13170 raft_consensus.cc:2229] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:40.366650 13170 raft_consensus.cc:2258] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:40.367079 13170 ts_tablet_manager.cc:1905] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:40.368583 13170 ts_tablet_manager.cc:1918] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:23:40.368666 13170 log.cc:1196] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/7d7d7de6ec3d4c71b0d0dd832d96f169
I20260809 03:23:40.368901 13170 ts_tablet_manager.cc:1939] T 7d7d7de6ec3d4c71b0d0dd832d96f169 P 21b711a6ecfb4a88bbee12986ba4671f: Deleting consensus metadata
I20260809 03:23:40.369280 12629 catalog_manager.cc:4841] TS 21b711a6ecfb4a88bbee12986ba4671f (127.8.5.194:41771): tablet 7d7d7de6ec3d4c71b0d0dd832d96f169 (table test-table [id=fae6df5f5a0945979b7b8a5a7d7399a0]) successfully deleted
W20260809 03:23:40.375172 12628 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.5.193:46755 (error 108)
I20260809 03:23:40.375478 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 12854
I20260809 03:23:40.375656 13140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.375507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:46755 (local address 127.0.0.1:57090)
0809 03:23:40.375569 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:40.375617 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.193:46755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 03:23:40.376191 12628 catalog_manager.cc:4584] TS 4ea704fbc29a4e63bd593967dde36a7e (127.8.5.193:46755): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7d7d7de6ec3d4c71b0d0dd832d96f169: Network error: Client connection negotiation failed: client connection to 127.8.5.193:46755: connect: Connection refused (error 111)
I20260809 03:23:40.382072 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 12996
I20260809 03:23:40.388283 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 12611
2026-08-09T03:23:40Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (1947 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T03:23:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:40Z Disabled control of system clock
I20260809 03:23:40.416878 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:41525
--webserver_interface=127.8.5.254
--webserver_port=0
--builtin_ntp_servers=127.8.5.212:36961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:41525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 03:23:40.497045 13176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:40.497224 13176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:40.497244 13176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:40.498282 13176 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:40.498319 13176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:40.498332 13176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:40.498344 13176 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:40.498355 13176 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:23:40.499672 13176 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:36961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:41525
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:41525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:40.499850 13176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:40.500066 13176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:40.504715 13186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:40.504746 13182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:40.504741 13183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:40.505126 13176 server_base.cc:1034] running on GCE node
I20260809 03:23:40.505378 13176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:40.505664 13176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:40.506830 13176 hybrid_clock.cc:648] HybridClock initialized: now 1786245820506825 us; error 37 us; skew 500 ppm
I20260809 03:23:40.507993 13176 webserver.cc:460] Webserver started at http://127.8.5.254:43111/ using document root <none> and password file <none>
I20260809 03:23:40.508237 13176 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:40.508306 13176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:40.508466 13176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:40.509444 13176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "c9b0e9c499e94400b52e629f33d54007"
format_stamp: "Formatted at 2026-08-09 03:23:40 on dist-test-slave-2w3w"
server_key: "334633dac80e26e6f8828b6e3b6fa919"
server_key_iv: "cc3dc57912905544d5f3ff142cdcf88d"
server_key_version: "encryptionkey@0"
I20260809 03:23:40.509774 13176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "c9b0e9c499e94400b52e629f33d54007"
format_stamp: "Formatted at 2026-08-09 03:23:40 on dist-test-slave-2w3w"
server_key: "334633dac80e26e6f8828b6e3b6fa919"
server_key_iv: "cc3dc57912905544d5f3ff142cdcf88d"
server_key_version: "encryptionkey@0"
I20260809 03:23:40.511152 13176 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:23:40.511901 13192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:40.512086 13176 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:40.512180 13176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "c9b0e9c499e94400b52e629f33d54007"
format_stamp: "Formatted at 2026-08-09 03:23:40 on dist-test-slave-2w3w"
server_key: "334633dac80e26e6f8828b6e3b6fa919"
server_key_iv: "cc3dc57912905544d5f3ff142cdcf88d"
server_key_version: "encryptionkey@0"
I20260809 03:23:40.512265 13176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:40.515455 13176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:40.515700 13176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:40.515844 13176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:40.519773 13176 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:41525
I20260809 03:23:40.519809 13244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:41525 every 8 connection(s)
I20260809 03:23:40.520110 13176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:40.520742 13245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:40.521234 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 13176
I20260809 03:23:40.521355 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:23:40.521517 8215 external_mini_cluster.cc:1428] Setting key 196c19f0e2240cccd2a8a14411458333
I20260809 03:23:40.524088 13248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.522030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43790 (local address 127.8.5.254:41525)
0809 03:23:40.522236 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:40.522245 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:40.522276 (+ 31us) server_negotiation.cc:407] Connection header received
0809 03:23:40.522824 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:40.522833 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:40.522892 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:40.523054 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:40.523662 (+ 608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:40.523665 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:40.523665 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:23:40.523670 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:40.523715 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:23:40.523728 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:40.523803 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:40.523871 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 03:23:40.523923 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":86,"threads_started":1}
I20260809 03:23:40.524525 13245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007: Bootstrap starting.
I20260809 03:23:40.525146 13245 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:40.525434 13245 log.cc:824] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:40.526103 13245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007: No bootstrap required, opened a new log
I20260809 03:23:40.527426 13245 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b0e9c499e94400b52e629f33d54007" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 41525 } }
I20260809 03:23:40.527559 13245 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:40.527606 13245 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9b0e9c499e94400b52e629f33d54007, State: Initialized, Role: FOLLOWER
I20260809 03:23:40.527719 13245 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b0e9c499e94400b52e629f33d54007" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 41525 } }
I20260809 03:23:40.527801 13245 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:40.527840 13245 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:40.527906 13245 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:40.528407 13245 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b0e9c499e94400b52e629f33d54007" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 41525 } }
I20260809 03:23:40.528518 13245 leader_election.cc:302] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9b0e9c499e94400b52e629f33d54007; no voters:
I20260809 03:23:40.528676 13245 leader_election.cc:288] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:23:40.528919 13245 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:40.528946 13250 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:40.529094 13250 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007 [term 1 LEADER]: Becoming Leader. State: Replica: c9b0e9c499e94400b52e629f33d54007, State: Running, Role: LEADER
I20260809 03:23:40.529186 13250 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b0e9c499e94400b52e629f33d54007" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 41525 } }
I20260809 03:23:40.529569 13252 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9b0e9c499e94400b52e629f33d54007. Latest consensus state: current_term: 1 leader_uuid: "c9b0e9c499e94400b52e629f33d54007" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b0e9c499e94400b52e629f33d54007" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 41525 } } }
I20260809 03:23:40.529686 13252 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:40.529911 13260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:40.530052 13251 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9b0e9c499e94400b52e629f33d54007" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b0e9c499e94400b52e629f33d54007" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 41525 } } }
I20260809 03:23:40.530113 13251 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:40.530519 13260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:40.531953 13260 catalog_manager.cc:1347] Generated new cluster ID: af175330568e40f3a0f63b7d918b91ad
I20260809 03:23:40.532006 13260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:23:40.544618 13260 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:23:40.544762 13260 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:40.549063 13260 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007: Generated new TSK 0
I20260809 03:23:40.549221 13260 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:23:40.554440 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:41525
--builtin_ntp_servers=127.8.5.212:36961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 03:23:40.647938 13271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:40.648131 13271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:40.648154 13271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:40.649300 13271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:40.649338 13271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:40.649363 13271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:23:40.650689 13271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:36961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:41525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:40.650931 13271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:40.651258 13271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:40.657588 13276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:40.657609 13279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:40.657609 13277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:40.658077 13271 server_base.cc:1034] running on GCE node
I20260809 03:23:40.658319 13271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:40.658560 13271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:40.659726 13271 hybrid_clock.cc:648] HybridClock initialized: now 1786245820659712 us; error 33 us; skew 500 ppm
I20260809 03:23:40.660956 13271 webserver.cc:460] Webserver started at http://127.8.5.193:41561/ using document root <none> and password file <none>
I20260809 03:23:40.661217 13271 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:40.661290 13271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:40.661453 13271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:40.662493 13271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "eab4a75805e04df49e2e5924afb690bb"
format_stamp: "Formatted at 2026-08-09 03:23:40 on dist-test-slave-2w3w"
server_key: "8aa2fe838971a71e7dc96acc6a38b848"
server_key_iv: "9fac95f11f2b4f0ac7fc9035b7cd07b5"
server_key_version: "encryptionkey@0"
I20260809 03:23:40.662850 13271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "eab4a75805e04df49e2e5924afb690bb"
format_stamp: "Formatted at 2026-08-09 03:23:40 on dist-test-slave-2w3w"
server_key: "8aa2fe838971a71e7dc96acc6a38b848"
server_key_iv: "9fac95f11f2b4f0ac7fc9035b7cd07b5"
server_key_version: "encryptionkey@0"
I20260809 03:23:40.664250 13271 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:23:40.665097 13285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:40.665298 13271 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:23:40.665412 13271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "eab4a75805e04df49e2e5924afb690bb"
format_stamp: "Formatted at 2026-08-09 03:23:40 on dist-test-slave-2w3w"
server_key: "8aa2fe838971a71e7dc96acc6a38b848"
server_key_iv: "9fac95f11f2b4f0ac7fc9035b7cd07b5"
server_key_version: "encryptionkey@0"
I20260809 03:23:40.665484 13271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:40.668823 13271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:40.669093 13271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:40.669235 13271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:40.669445 13271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:40.669746 13271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:40.669799 13271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:40.669840 13271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:40.669869 13271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:40.676174 13271 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:34571
I20260809 03:23:40.676218 13405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:34571 every 8 connection(s)
I20260809 03:23:40.676553 13271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:23:40.679811 13248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.677355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:43395 (local address 127.8.5.254:41525)
0809 03:23:40.677409 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:40.677412 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:40.677653 (+ 241us) server_negotiation.cc:407] Connection header received
0809 03:23:40.678252 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:40.678253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:40.678258 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:40.678300 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:40.679586 (+ 1286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:40.679587 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:40.679587 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:23:40.679591 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:40.679605 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:23:40.679608 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:40.679657 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:40.679746 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 03:23:40.679758 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 03:23:40.680037 13408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.677306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:41525 (local address 127.8.5.193:43395)
0809 03:23:40.677511 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:40.677552 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:40.678144 (+ 592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:40.678367 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:40.678371 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:40.678381 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:40.679417 (+ 1036us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:23:40.679418 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:40.679454 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:23:40.679489 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:40.679670 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:40.679674 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:40.679677 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:23:40.679751 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 03:23:40.679811 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":93,"threads_started":1}
I20260809 03:23:40.680579 13406 heartbeater.cc:347] Connected to a master server at 127.8.5.254:41525
I20260809 03:23:40.680684 13406 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:40.680832 13406 heartbeater.cc:511] Master 127.8.5.254:41525 requested a full tablet report, sending...
I20260809 03:23:40.681325 13209 ts_manager.cc:194] Registered new tserver with Master: eab4a75805e04df49e2e5924afb690bb (127.8.5.193:34571)
I20260809 03:23:40.681986 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 13271
I20260809 03:23:40.682089 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:23:40.682277 8215 external_mini_cluster.cc:1428] Setting key a088d4a9a35b8d3457e340e640129262
I20260809 03:23:40.683233 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:41525
--builtin_ntp_servers=127.8.5.212:36961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 03:23:40.765126 13409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:40.765316 13409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:40.765338 13409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:40.766518 13409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:40.766553 13409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:40.766578 13409 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:23:40.768321 13409 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:36961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:41525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:40.768553 13409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:40.768846 13409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:40.773896 13416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:40.773875 13409 server_base.cc:1034] running on GCE node
W20260809 03:23:40.773849 13414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:40.773856 13418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:40.774362 13409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:40.774626 13409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:40.775797 13409 hybrid_clock.cc:648] HybridClock initialized: now 1786245820775780 us; error 30 us; skew 500 ppm
I20260809 03:23:40.777056 13409 webserver.cc:460] Webserver started at http://127.8.5.194:41251/ using document root <none> and password file <none>
I20260809 03:23:40.777319 13409 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:40.777392 13409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:40.777552 13409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:40.778661 13409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "f7faf93c468749f59e6cb1ebcad0f15c"
format_stamp: "Formatted at 2026-08-09 03:23:40 on dist-test-slave-2w3w"
server_key: "9dd04ba84229589f47629a49ca1e5dd5"
server_key_iv: "aaad7e5782d2d8116482a72213ae883e"
server_key_version: "encryptionkey@0"
I20260809 03:23:40.779095 13409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "f7faf93c468749f59e6cb1ebcad0f15c"
format_stamp: "Formatted at 2026-08-09 03:23:40 on dist-test-slave-2w3w"
server_key: "9dd04ba84229589f47629a49ca1e5dd5"
server_key_iv: "aaad7e5782d2d8116482a72213ae883e"
server_key_version: "encryptionkey@0"
I20260809 03:23:40.780398 13409 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:23:40.781123 13424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:40.781311 13409 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:23:40.781404 13409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "f7faf93c468749f59e6cb1ebcad0f15c"
format_stamp: "Formatted at 2026-08-09 03:23:40 on dist-test-slave-2w3w"
server_key: "9dd04ba84229589f47629a49ca1e5dd5"
server_key_iv: "aaad7e5782d2d8116482a72213ae883e"
server_key_version: "encryptionkey@0"
I20260809 03:23:40.781487 13409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:40.784893 13409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:40.785135 13409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:40.785251 13409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:40.785447 13409 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:40.785689 13409 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:40.785718 13409 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:40.785737 13409 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:40.785749 13409 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:40.791131 13409 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:46869
I20260809 03:23:40.791167 13543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:46869 every 8 connection(s)
I20260809 03:23:40.791515 13409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:23:40.794730 13248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.793262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:45307 (local address 127.8.5.254:41525)
0809 03:23:40.793333 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:40.793335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:40.793345 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:23:40.793382 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:40.793383 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:40.793389 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:40.793446 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:40.794564 (+ 1118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:40.794564 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:40.794565 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:23:40.794567 (+ 2us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:40.794577 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:23:40.794580 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:40.794619 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:40.794667 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 03:23:40.794677 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 03:23:40.794992 13546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.792279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:41525 (local address 127.8.5.194:45307)
0809 03:23:40.792473 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:40.792511 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:40.793202 (+ 691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:40.793496 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:40.793499 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:40.793513 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:40.794437 (+ 924us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:23:40.794438 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:40.794463 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:23:40.794490 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:40.794620 (+ 130us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:40.794622 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:40.794624 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:23:40.794672 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 03:23:40.794716 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":93,"threads_started":1}
I20260809 03:23:40.795519 13544 heartbeater.cc:347] Connected to a master server at 127.8.5.254:41525
I20260809 03:23:40.795612 13544 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:40.795753 13544 heartbeater.cc:511] Master 127.8.5.254:41525 requested a full tablet report, sending...
I20260809 03:23:40.796169 13209 ts_manager.cc:194] Registered new tserver with Master: f7faf93c468749f59e6cb1ebcad0f15c (127.8.5.194:46869)
I20260809 03:23:40.798491 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 13409
I20260809 03:23:40.798573 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:23:40.798707 8215 external_mini_cluster.cc:1428] Setting key b7fa6182680372b56d48b063e03477ff
I20260809 03:23:40.799579 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:41525
--builtin_ntp_servers=127.8.5.212:36961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 03:23:40.879863 13547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:40.880079 13547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:40.880115 13547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:40.881263 13547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:40.881327 13547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:40.881372 13547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:23:40.882697 13547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:36961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:41525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:40.883024 13547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:40.883309 13547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:40.888324 13552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:40.888339 13555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:40.888310 13553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:40.888589 13547 server_base.cc:1034] running on GCE node
I20260809 03:23:40.888774 13547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:40.888993 13547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:40.890156 13547 hybrid_clock.cc:648] HybridClock initialized: now 1786245820890144 us; error 30 us; skew 500 ppm
I20260809 03:23:40.891377 13547 webserver.cc:460] Webserver started at http://127.8.5.195:43629/ using document root <none> and password file <none>
I20260809 03:23:40.891608 13547 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:40.891654 13547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:40.891825 13547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:40.892860 13547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "a34912d0b21d408ba543a5c665170bef"
format_stamp: "Formatted at 2026-08-09 03:23:40 on dist-test-slave-2w3w"
server_key: "ff125a58f4bf5c10bdae4ca1dd2405fc"
server_key_iv: "47b6df60ea5d9b1dcf73b4139cd52048"
server_key_version: "encryptionkey@0"
I20260809 03:23:40.893227 13547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "a34912d0b21d408ba543a5c665170bef"
format_stamp: "Formatted at 2026-08-09 03:23:40 on dist-test-slave-2w3w"
server_key: "ff125a58f4bf5c10bdae4ca1dd2405fc"
server_key_iv: "47b6df60ea5d9b1dcf73b4139cd52048"
server_key_version: "encryptionkey@0"
I20260809 03:23:40.894520 13547 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:23:40.895303 13561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:40.895489 13547 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:40.895576 13547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "a34912d0b21d408ba543a5c665170bef"
format_stamp: "Formatted at 2026-08-09 03:23:40 on dist-test-slave-2w3w"
server_key: "ff125a58f4bf5c10bdae4ca1dd2405fc"
server_key_iv: "47b6df60ea5d9b1dcf73b4139cd52048"
server_key_version: "encryptionkey@0"
I20260809 03:23:40.895648 13547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:40.899011 13547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:40.899299 13547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:40.899435 13547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:40.899673 13547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:40.899966 13547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:40.899997 13547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:40.900049 13547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:40.900077 13547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:40.906032 13547 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:38515
I20260809 03:23:40.906093 13683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:38515 every 8 connection(s)
I20260809 03:23:40.906361 13547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:23:40.909219 13248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.907026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:60731 (local address 127.8.5.254:41525)
0809 03:23:40.907069 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:40.907071 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:40.907332 (+ 261us) server_negotiation.cc:407] Connection header received
0809 03:23:40.907833 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:40.907834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:40.907842 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:40.907893 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:40.908983 (+ 1090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:40.908985 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:40.908985 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:23:40.908989 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:40.909005 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:23:40.909009 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:40.909059 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:40.909137 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 03:23:40.909151 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 03:23:40.909395 13686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.907037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:41525 (local address 127.8.5.195:60731)
0809 03:23:40.907214 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:40.907244 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:40.907709 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:40.907955 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:40.907958 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:40.907967 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:40.908838 (+ 871us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:23:40.908838 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:40.908863 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:23:40.908888 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:40.909058 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:40.909063 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:40.909066 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:23:40.909139 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 03:23:40.909195 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":79,"threads_started":1}
I20260809 03:23:40.909808 13684 heartbeater.cc:347] Connected to a master server at 127.8.5.254:41525
I20260809 03:23:40.909885 13684 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:40.910044 13684 heartbeater.cc:511] Master 127.8.5.254:41525 requested a full tablet report, sending...
I20260809 03:23:40.910377 13209 ts_manager.cc:194] Registered new tserver with Master: a34912d0b21d408ba543a5c665170bef (127.8.5.195:38515)
I20260809 03:23:40.914405 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 13547
I20260809 03:23:40.914484 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:23:40.914639 8215 external_mini_cluster.cc:1428] Setting key d5387072de95763a9784668bf70e2fd6
I20260809 03:23:40.915505 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:23:40.917577 13248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.916803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43804 (local address 127.8.5.254:41525)
0809 03:23:40.916835 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:40.916837 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:40.916929 (+ 92us) server_negotiation.cc:407] Connection header received
0809 03:23:40.916981 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:40.916981 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:40.916985 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:40.917028 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:40.917438 (+ 410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:40.917439 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:40.917439 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:23:40.917442 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:40.917452 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:23:40.917455 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:40.917497 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:40.917528 (+ 31us) server_negotiation.cc:299] Negotiation successful
0809 03:23:40.917537 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260809 03:23:40.918917 13209 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43804:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:23:40.920487 13209 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:23:40.923969 13695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.922425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:46869 (local address 127.0.0.1:41640)
0809 03:23:40.922636 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:40.922682 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:40.922731 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:40.923082 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:40.923088 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:40.923094 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:40.923537 (+ 443us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:23:40.923538 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:40.923553 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:23:40.923574 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:40.923797 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:40.923804 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:40.923807 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:23:40.923878 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 03:23:40.923891 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":104,"threads_started":1}
I20260809 03:23:40.924211 13699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.922721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41640 (local address 127.8.5.194:46869)
0809 03:23:40.922938 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:40.922942 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:40.922952 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:23:40.922978 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:40.922980 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:40.923007 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:40.923082 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:40.923655 (+ 573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:40.923663 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:40.923663 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:23:40.923668 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:40.923698 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:23:40.923721 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:40.923772 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:40.924111 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 03:23:40.924128 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":99,"threads_started":1}
I20260809 03:23:40.924407 13696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.922432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:34571 (local address 127.0.0.1:51732)
0809 03:23:40.922866 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:40.922876 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:40.922924 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:40.923434 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:40.923435 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:40.923438 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:40.923891 (+ 453us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:23:40.923892 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:40.923898 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:23:40.923909 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:40.924277 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:40.924278 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:40.924279 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 03:23:40.924335 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 03:23:40.924347 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":100,"threads_started":1}
I20260809 03:23:40.924454 13698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.922706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51732 (local address 127.8.5.193:34571)
0809 03:23:40.922887 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:40.922892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:40.922920 (+ 28us) server_negotiation.cc:407] Connection header received
0809 03:23:40.923010 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:40.923013 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:40.923023 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:40.923117 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:40.924006 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:40.924107 (+ 101us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:40.924107 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:23:40.924113 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:40.924148 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:23:40.924183 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:40.924239 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:40.924357 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 03:23:40.924375 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":98,"threads_started":1}
I20260809 03:23:40.924885 13694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.922561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:38515 (local address 127.0.0.1:47684)
0809 03:23:40.923460 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:40.923470 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:40.923540 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:40.923723 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:40.923724 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:40.923726 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:40.924515 (+ 789us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:23:40.924515 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:40.924523 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:23:40.924535 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:40.924746 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:40.924747 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:40.924748 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 03:23:40.924799 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 03:23:40.924810 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":887,"thread_start_us":73,"threads_started":1}
I20260809 03:23:40.924888 13697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:40.922620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47684 (local address 127.8.5.195:38515)
0809 03:23:40.923082 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:40.923085 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:40.923595 (+ 510us) server_negotiation.cc:407] Connection header received
0809 03:23:40.923620 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:40.923623 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:40.923632 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:40.923708 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:40.924598 (+ 890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:40.924604 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:40.924605 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:23:40.924609 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:40.924639 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:23:40.924659 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:40.924719 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:40.924812 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 03:23:40.924828 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":80,"threads_started":1}
I20260809 03:23:40.924837 13474 tablet_service.cc:1467] Processing CreateTablet for tablet 16076b78830949778002edac8e3c0bf5 (DEFAULT_TABLE table=test-table [id=fb08ae44561e473988bfeaeafbb14848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:40.925177 13474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16076b78830949778002edac8e3c0bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:40.927451 13338 tablet_service.cc:1467] Processing CreateTablet for tablet 16076b78830949778002edac8e3c0bf5 (DEFAULT_TABLE table=test-table [id=fb08ae44561e473988bfeaeafbb14848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:40.927620 13613 tablet_service.cc:1467] Processing CreateTablet for tablet 16076b78830949778002edac8e3c0bf5 (DEFAULT_TABLE table=test-table [id=fb08ae44561e473988bfeaeafbb14848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:40.927755 13338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16076b78830949778002edac8e3c0bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:40.927942 13613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16076b78830949778002edac8e3c0bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:40.927978 13700 tablet_bootstrap.cc:492] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c: Bootstrap starting.
I20260809 03:23:40.928697 13700 tablet_bootstrap.cc:654] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:40.929033 13700 log.cc:824] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:40.929957 13700 tablet_bootstrap.cc:492] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c: No bootstrap required, opened a new log
I20260809 03:23:40.930030 13700 ts_tablet_manager.cc:1397] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:23:40.930860 13702 tablet_bootstrap.cc:492] T 16076b78830949778002edac8e3c0bf5 P eab4a75805e04df49e2e5924afb690bb: Bootstrap starting.
I20260809 03:23:40.931591 13702 tablet_bootstrap.cc:654] T 16076b78830949778002edac8e3c0bf5 P eab4a75805e04df49e2e5924afb690bb: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:40.931890 13702 log.cc:824] T 16076b78830949778002edac8e3c0bf5 P eab4a75805e04df49e2e5924afb690bb: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:40.932619 13702 tablet_bootstrap.cc:492] T 16076b78830949778002edac8e3c0bf5 P eab4a75805e04df49e2e5924afb690bb: No bootstrap required, opened a new log
I20260809 03:23:40.932581 13700 raft_consensus.cc:348] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7faf93c468749f59e6cb1ebcad0f15c" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46869 } } peers { permanent_uuid: "eab4a75805e04df49e2e5924afb690bb" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 34571 } } peers { permanent_uuid: "a34912d0b21d408ba543a5c665170bef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 38515 } }
I20260809 03:23:40.932700 13702 ts_tablet_manager.cc:1397] T 16076b78830949778002edac8e3c0bf5 P eab4a75805e04df49e2e5924afb690bb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:23:40.932689 13700 raft_consensus.cc:374] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:40.932753 13700 raft_consensus.cc:729] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7faf93c468749f59e6cb1ebcad0f15c, State: Initialized, Role: FOLLOWER
I20260809 03:23:40.932868 13700 consensus_queue.cc:260] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7faf93c468749f59e6cb1ebcad0f15c" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46869 } } peers { permanent_uuid: "eab4a75805e04df49e2e5924afb690bb" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 34571 } } peers { permanent_uuid: "a34912d0b21d408ba543a5c665170bef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 38515 } }
I20260809 03:23:40.933112 13700 ts_tablet_manager.cc:1428] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 03:23:40.933192 13544 heartbeater.cc:503] Master 127.8.5.254:41525 was elected leader, sending a full tablet report...
I20260809 03:23:40.933352 13703 tablet_bootstrap.cc:492] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef: Bootstrap starting.
I20260809 03:23:40.934011 13703 tablet_bootstrap.cc:654] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:40.934373 13703 log.cc:824] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:40.935185 13703 tablet_bootstrap.cc:492] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef: No bootstrap required, opened a new log
I20260809 03:23:40.935235 13703 ts_tablet_manager.cc:1397] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:23:40.935499 13702 raft_consensus.cc:348] T 16076b78830949778002edac8e3c0bf5 P eab4a75805e04df49e2e5924afb690bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7faf93c468749f59e6cb1ebcad0f15c" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46869 } } peers { permanent_uuid: "eab4a75805e04df49e2e5924afb690bb" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 34571 } } peers { permanent_uuid: "a34912d0b21d408ba543a5c665170bef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 38515 } }
I20260809 03:23:40.935642 13702 raft_consensus.cc:374] T 16076b78830949778002edac8e3c0bf5 P eab4a75805e04df49e2e5924afb690bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:40.935683 13702 raft_consensus.cc:729] T 16076b78830949778002edac8e3c0bf5 P eab4a75805e04df49e2e5924afb690bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eab4a75805e04df49e2e5924afb690bb, State: Initialized, Role: FOLLOWER
I20260809 03:23:40.935806 13702 consensus_queue.cc:260] T 16076b78830949778002edac8e3c0bf5 P eab4a75805e04df49e2e5924afb690bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7faf93c468749f59e6cb1ebcad0f15c" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46869 } } peers { permanent_uuid: "eab4a75805e04df49e2e5924afb690bb" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 34571 } } peers { permanent_uuid: "a34912d0b21d408ba543a5c665170bef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 38515 } }
I20260809 03:23:40.936051 13702 ts_tablet_manager.cc:1428] T 16076b78830949778002edac8e3c0bf5 P eab4a75805e04df49e2e5924afb690bb: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 03:23:40.936093 13406 heartbeater.cc:503] Master 127.8.5.254:41525 was elected leader, sending a full tablet report...
I20260809 03:23:40.937645 13703 raft_consensus.cc:348] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7faf93c468749f59e6cb1ebcad0f15c" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46869 } } peers { permanent_uuid: "eab4a75805e04df49e2e5924afb690bb" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 34571 } } peers { permanent_uuid: "a34912d0b21d408ba543a5c665170bef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 38515 } }
I20260809 03:23:40.937757 13703 raft_consensus.cc:374] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:40.937775 13703 raft_consensus.cc:729] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a34912d0b21d408ba543a5c665170bef, State: Initialized, Role: FOLLOWER
I20260809 03:23:40.937847 13703 consensus_queue.cc:260] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7faf93c468749f59e6cb1ebcad0f15c" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46869 } } peers { permanent_uuid: "eab4a75805e04df49e2e5924afb690bb" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 34571 } } peers { permanent_uuid: "a34912d0b21d408ba543a5c665170bef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 38515 } }
I20260809 03:23:40.938009 13703 ts_tablet_manager.cc:1428] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 03:23:40.938077 13684 heartbeater.cc:503] Master 127.8.5.254:41525 was elected leader, sending a full tablet report...
I20260809 03:23:41.015364 13705 raft_consensus.cc:482] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:23:41.015659 13705 raft_consensus.cc:504] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7faf93c468749f59e6cb1ebcad0f15c" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46869 } } peers { permanent_uuid: "eab4a75805e04df49e2e5924afb690bb" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 34571 } } peers { permanent_uuid: "a34912d0b21d408ba543a5c665170bef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 38515 } }
I20260809 03:23:41.015996 13705 leader_election.cc:288] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eab4a75805e04df49e2e5924afb690bb (127.8.5.193:34571), a34912d0b21d408ba543a5c665170bef (127.8.5.195:38515)
I20260809 03:23:41.017439 13698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:41.016296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:52669 (local address 127.8.5.193:34571)
0809 03:23:41.016349 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:41.016351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:41.016360 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:23:41.016434 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:41.016435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:41.016441 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:41.016500 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:41.017196 (+ 696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:41.017197 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:41.017198 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:23:41.017203 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:41.017223 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:23:41.017228 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:41.017283 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:41.017341 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 03:23:41.017356 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 03:23:41.017453 13546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:41.016202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:34571 (local address 127.8.5.194:52669)
0809 03:23:41.016292 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:41.016307 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:41.016361 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:41.016515 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:41.016516 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:41.016518 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:41.017079 (+ 561us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:23:41.017080 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:41.017089 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:23:41.017102 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:41.017292 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:41.017293 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:41.017293 (+ 0us) client_negotiation.cc:769] Sending connection context
0809 03:23:41.017339 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 03:23:41.017375 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 03:23:41.017664 13697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:41.016281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:52775 (local address 127.8.5.195:38515)
0809 03:23:41.016328 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:41.016330 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:41.016462 (+ 132us) server_negotiation.cc:407] Connection header received
0809 03:23:41.016538 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:41.016539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:41.016544 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:41.016596 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:41.017393 (+ 797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:41.017395 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:41.017395 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:23:41.017399 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:41.017416 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:23:41.017420 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:41.017476 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:41.017577 (+ 101us) server_negotiation.cc:299] Negotiation successful
0809 03:23:41.017592 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:23:41.017838 13709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:41.016202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:38515 (local address 127.8.5.194:52775)
0809 03:23:41.016387 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:41.016396 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:41.016481 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:41.016639 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:41.016640 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:41.016642 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:41.017287 (+ 645us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:23:41.017288 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:41.017294 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:23:41.017304 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:41.017487 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:41.017488 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:41.017488 (+ 0us) client_negotiation.cc:769] Sending connection context
0809 03:23:41.017745 (+ 257us) client_negotiation.cc:240] Negotiation successful
0809 03:23:41.017762 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":14,"thread_start_us":99,"threads_started":1}
I20260809 03:23:41.017799 13359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16076b78830949778002edac8e3c0bf5" candidate_uuid: "f7faf93c468749f59e6cb1ebcad0f15c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eab4a75805e04df49e2e5924afb690bb" is_pre_election: true
I20260809 03:23:41.017980 13359 raft_consensus.cc:2454] T 16076b78830949778002edac8e3c0bf5 P eab4a75805e04df49e2e5924afb690bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7faf93c468749f59e6cb1ebcad0f15c in term 0.
I20260809 03:23:41.018257 13426 leader_election.cc:302] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eab4a75805e04df49e2e5924afb690bb, f7faf93c468749f59e6cb1ebcad0f15c; no voters:
I20260809 03:23:41.018312 13634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16076b78830949778002edac8e3c0bf5" candidate_uuid: "f7faf93c468749f59e6cb1ebcad0f15c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a34912d0b21d408ba543a5c665170bef" is_pre_election: true
I20260809 03:23:41.018384 13705 raft_consensus.cc:2781] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:23:41.018445 13705 raft_consensus.cc:482] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:23:41.018476 13705 raft_consensus.cc:3037] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:41.018468 13634 raft_consensus.cc:2454] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7faf93c468749f59e6cb1ebcad0f15c in term 0.
I20260809 03:23:41.019328 13705 raft_consensus.cc:504] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7faf93c468749f59e6cb1ebcad0f15c" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46869 } } peers { permanent_uuid: "eab4a75805e04df49e2e5924afb690bb" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 34571 } } peers { permanent_uuid: "a34912d0b21d408ba543a5c665170bef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 38515 } }
I20260809 03:23:41.019475 13705 leader_election.cc:288] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [CANDIDATE]: Term 1 election: Requested vote from peers eab4a75805e04df49e2e5924afb690bb (127.8.5.193:34571), a34912d0b21d408ba543a5c665170bef (127.8.5.195:38515)
I20260809 03:23:41.019604 13359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16076b78830949778002edac8e3c0bf5" candidate_uuid: "f7faf93c468749f59e6cb1ebcad0f15c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eab4a75805e04df49e2e5924afb690bb"
I20260809 03:23:41.019619 13634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16076b78830949778002edac8e3c0bf5" candidate_uuid: "f7faf93c468749f59e6cb1ebcad0f15c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a34912d0b21d408ba543a5c665170bef"
I20260809 03:23:41.019690 13634 raft_consensus.cc:3037] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:41.019692 13359 raft_consensus.cc:3037] T 16076b78830949778002edac8e3c0bf5 P eab4a75805e04df49e2e5924afb690bb [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:41.020601 13359 raft_consensus.cc:2454] T 16076b78830949778002edac8e3c0bf5 P eab4a75805e04df49e2e5924afb690bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7faf93c468749f59e6cb1ebcad0f15c in term 1.
I20260809 03:23:41.020601 13634 raft_consensus.cc:2454] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7faf93c468749f59e6cb1ebcad0f15c in term 1.
I20260809 03:23:41.020771 13428 leader_election.cc:302] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a34912d0b21d408ba543a5c665170bef, f7faf93c468749f59e6cb1ebcad0f15c; no voters:
I20260809 03:23:41.020888 13705 raft_consensus.cc:2781] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:41.021075 13705 raft_consensus.cc:686] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [term 1 LEADER]: Becoming Leader. State: Replica: f7faf93c468749f59e6cb1ebcad0f15c, State: Running, Role: LEADER
I20260809 03:23:41.021173 13705 consensus_queue.cc:237] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7faf93c468749f59e6cb1ebcad0f15c" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46869 } } peers { permanent_uuid: "eab4a75805e04df49e2e5924afb690bb" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 34571 } } peers { permanent_uuid: "a34912d0b21d408ba543a5c665170bef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 38515 } }
I20260809 03:23:41.021961 13208 catalog_manager.cc:5495] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c reported cstate change: term changed from 0 to 1, leader changed from <none> to f7faf93c468749f59e6cb1ebcad0f15c (127.8.5.194). New cstate: current_term: 1 leader_uuid: "f7faf93c468749f59e6cb1ebcad0f15c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7faf93c468749f59e6cb1ebcad0f15c" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 46869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eab4a75805e04df49e2e5924afb690bb" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 34571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a34912d0b21d408ba543a5c665170bef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 38515 } health_report { overall_health: UNKNOWN } } }
W20260809 03:23:41.042039 13545 tablet.cc:2369] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:23:41.042860 13699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:41.041920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41656 (local address 127.8.5.194:46869)
0809 03:23:41.041971 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:41.041973 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:41.041983 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:23:41.042062 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:41.042063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:41.042082 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:41.042151 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:41.042691 (+ 540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:41.042692 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:41.042692 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:23:41.042696 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:41.042710 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:23:41.042714 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:41.042764 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:41.042796 (+ 32us) server_negotiation.cc:299] Negotiation successful
0809 03:23:41.042807 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 03:23:41.044605 13359 raft_consensus.cc:1261] T 16076b78830949778002edac8e3c0bf5 P eab4a75805e04df49e2e5924afb690bb [term 1 FOLLOWER]: Refusing update from remote peer f7faf93c468749f59e6cb1ebcad0f15c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:41.044617 13634 raft_consensus.cc:1261] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef [term 1 FOLLOWER]: Refusing update from remote peer f7faf93c468749f59e6cb1ebcad0f15c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:41.045017 13710 consensus_queue.cc:1035] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a34912d0b21d408ba543a5c665170bef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 38515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:41.045136 13705 consensus_queue.cc:1035] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eab4a75805e04df49e2e5924afb690bb" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 34571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:41.049782 13714 mvcc.cc:205] Tried to move back new op lower bound from 7316462882996088832 to 7316462882903404544. Current Snapshot: MvccSnapshot[applied={T|T < 7316462882996088832}]
I20260809 03:23:41.050154 13209 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:41.050251 13209 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:41.050254 13715 mvcc.cc:205] Tried to move back new op lower bound from 7316462882996088832 to 7316462882903404544. Current Snapshot: MvccSnapshot[applied={T|T < 7316462882996088832}]
I20260809 03:23:41.051237 13209 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c9b0e9c499e94400b52e629f33d54007: Sending DeleteTablet for 3 replicas of tablet 16076b78830949778002edac8e3c0bf5
I20260809 03:23:41.051739 13613 tablet_service.cc:1514] Processing DeleteTablet for tablet 16076b78830949778002edac8e3c0bf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:41 UTC) from {username='slave'} at 127.0.0.1:47684
I20260809 03:23:41.051864 13338 tablet_service.cc:1514] Processing DeleteTablet for tablet 16076b78830949778002edac8e3c0bf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:41 UTC) from {username='slave'} at 127.0.0.1:51732
I20260809 03:23:41.052268 13722 tablet_replica.cc:330] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef: stopping tablet replica
I20260809 03:23:41.052407 13722 raft_consensus.cc:2229] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:41.052556 13722 raft_consensus.cc:2258] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:41.052769 13474 tablet_service.cc:1514] Processing DeleteTablet for tablet 16076b78830949778002edac8e3c0bf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:41 UTC) from {username='slave'} at 127.0.0.1:41640
I20260809 03:23:41.053243 13722 ts_tablet_manager.cc:1905] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:41.053298 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 13271
I20260809 03:23:41.054983 13722 ts_tablet_manager.cc:1918] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:23:41.055123 13722 log.cc:1196] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/16076b78830949778002edac8e3c0bf5
I20260809 03:23:41.055464 13722 ts_tablet_manager.cc:1939] T 16076b78830949778002edac8e3c0bf5 P a34912d0b21d408ba543a5c665170bef: Deleting consensus metadata
I20260809 03:23:41.055944 13196 catalog_manager.cc:4841] TS a34912d0b21d408ba543a5c665170bef (127.8.5.195:38515): tablet 16076b78830949778002edac8e3c0bf5 (table test-table [id=fb08ae44561e473988bfeaeafbb14848]) successfully deleted
I20260809 03:23:41.056454 13724 tablet_replica.cc:330] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c: stopping tablet replica
I20260809 03:23:41.056602 13724 raft_consensus.cc:2229] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:23:41.056735 13724 raft_consensus.cc:2258] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:41.057462 13724 ts_tablet_manager.cc:1905] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:41.059890 13724 ts_tablet_manager.cc:1918] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:23:41.059985 13724 log.cc:1196] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/16076b78830949778002edac8e3c0bf5
I20260809 03:23:41.060355 13724 ts_tablet_manager.cc:1939] T 16076b78830949778002edac8e3c0bf5 P f7faf93c468749f59e6cb1ebcad0f15c: Deleting consensus metadata
I20260809 03:23:41.060856 13195 catalog_manager.cc:4841] TS f7faf93c468749f59e6cb1ebcad0f15c (127.8.5.194:46869): tablet 16076b78830949778002edac8e3c0bf5 (table test-table [id=fb08ae44561e473988bfeaeafbb14848]) successfully deleted
W20260809 03:23:41.068751 13194 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.5.193:34571 (error 108)
I20260809 03:23:41.068944 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 13409
I20260809 03:23:41.070151 13694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:41.069959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:34571 (local address 127.0.0.1:51748)
0809 03:23:41.070064 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:41.070109 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.193:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
W20260809 03:23:41.070262 13194 catalog_manager.cc:4584] TS eab4a75805e04df49e2e5924afb690bb (127.8.5.193:34571): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 16076b78830949778002edac8e3c0bf5: Network error: Client connection negotiation failed: client connection to 127.8.5.193:34571: connect: Connection refused (error 111)
I20260809 03:23:41.074462 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 13547
I20260809 03:23:41.080662 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 13176
2026-08-09T03:23:41Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (691 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 03:23:41.101063 8215 mini_oidc.cc:152] Starting JWKS server
I20260809 03:23:41.102181 8215 webserver.cc:460] Webserver started at https://127.0.0.1:41853/ using document root <none> and password file <none>
I20260809 03:23:41.102309 8215 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 03:23:41.102501 8215 webserver.cc:460] Webserver started at http://127.0.0.1:36467/ using document root <none> and password file <none>
2026-08-09T03:23:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:41Z Disabled control of system clock
I20260809 03:23:41.111018 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:45075
--webserver_interface=127.8.5.254
--webserver_port=0
--builtin_ntp_servers=127.8.5.212:43947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:45075
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41853/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/testchainca.cert with env {}
W20260809 03:23:41.192893 13731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:41.193082 13731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:41.193104 13731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:41.194195 13731 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:41.194231 13731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:41.194243 13731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:41.194257 13731 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:41.194268 13731 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 03:23:41.194281 13731 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 03:23:41.194295 13731 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41853/jwks.json
I20260809 03:23:41.195784 13731 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:43947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:45075
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:45075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41853/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:41.195966 13731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:41.196123 13731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:41.200919 13737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:41.201102 13731 server_base.cc:1034] running on GCE node
W20260809 03:23:41.200937 13739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:41.200918 13736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:41.201440 13731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:41.201699 13731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:41.202876 13731 hybrid_clock.cc:648] HybridClock initialized: now 1786245821202850 us; error 42 us; skew 500 ppm
I20260809 03:23:41.204175 13731 webserver.cc:460] Webserver started at http://127.8.5.254:33581/ using document root <none> and password file <none>
I20260809 03:23:41.204411 13731 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:41.204454 13731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:41.204564 13731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:41.205555 13731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "cd9e9c0b74db495d8c5d4a91c0968ad5"
format_stamp: "Formatted at 2026-08-09 03:23:41 on dist-test-slave-2w3w"
server_key: "13ae3230c3ccc79bd0d4bfd3f56814e6"
server_key_iv: "bac9d6f9c9a4c653d59504e7995f8edd"
server_key_version: "encryptionkey@0"
I20260809 03:23:41.205854 13731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "cd9e9c0b74db495d8c5d4a91c0968ad5"
format_stamp: "Formatted at 2026-08-09 03:23:41 on dist-test-slave-2w3w"
server_key: "13ae3230c3ccc79bd0d4bfd3f56814e6"
server_key_iv: "bac9d6f9c9a4c653d59504e7995f8edd"
server_key_version: "encryptionkey@0"
I20260809 03:23:41.207127 13731 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:23:41.207855 13746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:41.208039 13731 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:41.208138 13731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "cd9e9c0b74db495d8c5d4a91c0968ad5"
format_stamp: "Formatted at 2026-08-09 03:23:41 on dist-test-slave-2w3w"
server_key: "13ae3230c3ccc79bd0d4bfd3f56814e6"
server_key_iv: "bac9d6f9c9a4c653d59504e7995f8edd"
server_key_version: "encryptionkey@0"
I20260809 03:23:41.208225 13731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:41.256017 13731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:41.256378 13731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:41.256544 13731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:41.260902 13731 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:45075
I20260809 03:23:41.260937 13801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:45075 every 8 connection(s)
I20260809 03:23:41.261312 13731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:41.262351 13802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:41.264640 13802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5: Bootstrap starting.
I20260809 03:23:41.265175 13802 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:41.265479 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 13731
I20260809 03:23:41.265524 13802 log.cc:824] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:41.265585 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:23:41.265779 8215 external_mini_cluster.cc:1428] Setting key 3984181ae9e6edb1fafe95f9df423ecc
I20260809 03:23:41.266250 13802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5: No bootstrap required, opened a new log
I20260809 03:23:41.267966 13802 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd9e9c0b74db495d8c5d4a91c0968ad5" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45075 } }
I20260809 03:23:41.268123 13802 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:41.268170 13802 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd9e9c0b74db495d8c5d4a91c0968ad5, State: Initialized, Role: FOLLOWER
I20260809 03:23:41.268299 13802 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd9e9c0b74db495d8c5d4a91c0968ad5" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45075 } }
I20260809 03:23:41.268399 13802 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:41.268438 13802 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:41.268494 13802 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:41.269217 13802 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd9e9c0b74db495d8c5d4a91c0968ad5" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45075 } }
I20260809 03:23:41.269327 13802 leader_election.cc:302] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd9e9c0b74db495d8c5d4a91c0968ad5; no voters:
I20260809 03:23:41.269485 13802 leader_election.cc:288] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:23:41.269557 13809 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:41.269697 13809 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5 [term 1 LEADER]: Becoming Leader. State: Replica: cd9e9c0b74db495d8c5d4a91c0968ad5, State: Running, Role: LEADER
I20260809 03:23:41.269707 13802 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:41.269863 13809 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd9e9c0b74db495d8c5d4a91c0968ad5" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45075 } }
I20260809 03:23:41.270198 13809 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd9e9c0b74db495d8c5d4a91c0968ad5. Latest consensus state: current_term: 1 leader_uuid: "cd9e9c0b74db495d8c5d4a91c0968ad5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd9e9c0b74db495d8c5d4a91c0968ad5" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45075 } } }
I20260809 03:23:41.270285 13809 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:41.270208 13810 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd9e9c0b74db495d8c5d4a91c0968ad5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd9e9c0b74db495d8c5d4a91c0968ad5" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45075 } } }
I20260809 03:23:41.270390 13810 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:41.271142 13818 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:41.271804 13818 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:41.273433 13818 catalog_manager.cc:1347] Generated new cluster ID: 0f5839ad4872406fb795af932e316f17
I20260809 03:23:41.273484 13818 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:23:41.273921 13806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:41.266282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44944 (local address 127.8.5.254:45075)
0809 03:23:41.266480 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:41.266489 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:41.266522 (+ 33us) server_negotiation.cc:407] Connection header received
0809 03:23:41.267956 (+ 1434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:41.267963 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:41.268022 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:41.268165 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:41.268531 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.270311 (+ 1780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.271548 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.272134 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.272257 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:41.273009 (+ 752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:41.273013 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:41.273013 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:23:41.273212 (+ 199us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:41.273254 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:23:41.273268 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:41.273596 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:41.273629 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 03:23:41.273709 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":82,"threads_started":1}
I20260809 03:23:41.274888 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:23:41.278301 13818 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:23:41.278777 13818 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:41.282249 13818 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd9e9c0b74db495d8c5d4a91c0968ad5: Generated new TSK 0
I20260809 03:23:41.282423 13818 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 03:23:41.313797 13834 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 03:23:41.313971 13834 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 03:23:41.314162 13806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:41.290951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44960 (local address 127.8.5.254:45075)
0809 03:23:41.291004 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:41.291006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:41.291165 (+ 159us) server_negotiation.cc:407] Connection header received
0809 03:23:41.291263 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:41.291264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:41.291273 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:41.291336 (+ 63us) server_negotiation.cc:226] Negotiated authn=JWT
0809 03:23:41.291511 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.291967 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.293302 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.293479 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.293529 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:41.293747 (+ 218us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 03:23:41.313793 (+ 20046us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41853/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 03:23:41.314096 (+ 303us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44960: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41853/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":32}
W20260809 03:23:41.314219 13806 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44960: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41853/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 03:23:41.314461 13833 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:41.290891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:45075 (local address 127.0.0.1:44960)
0809 03:23:41.291097 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:41.291109 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:41.291175 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:41.291371 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:41.291372 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:41.291374 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0809 03:23:41.291440 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:41.291442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.292249 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.292250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:41.293223 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:41.293226 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.293553 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.293557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:41.293625 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:41.293649 (+ 24us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 03:23:41.313935 (+ 20286us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41853/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 03:23:41.314045 (+ 110us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.5.254:45075: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41853/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":102,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.8.5.254:45075: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41853/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 03:23:41.314990 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 13731
2026-08-09T03:23:41Z chronyd exiting
I20260809 03:23:41.352146 8215 test_util.cc:175] -----------------------------------------------
I20260809 03:23:41.352216 8215 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786245797426041-8215-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (252 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 03:23:41.352903 8215 mini_oidc.cc:152] Starting JWKS server
I20260809 03:23:41.353507 8215 webserver.cc:460] Webserver started at https://127.0.0.1:38319/ using document root <none> and password file <none>
I20260809 03:23:41.353544 8215 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 03:23:41.353706 8215 webserver.cc:460] Webserver started at http://127.0.0.1:39921/ using document root <none> and password file <none>
2026-08-09T03:23:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:41Z Disabled control of system clock
I20260809 03:23:41.361776 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:43951
--webserver_interface=127.8.5.254
--webserver_port=0
--builtin_ntp_servers=127.8.5.212:41667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:43951
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38319/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/testchainca.cert with env {}
W20260809 03:23:41.440915 13840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:41.441141 13840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:41.441179 13840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:41.442332 13840 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:41.442396 13840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:41.442418 13840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:41.442440 13840 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:41.442473 13840 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 03:23:41.442492 13840 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 03:23:41.442513 13840 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38319/jwks.json
I20260809 03:23:41.444069 13840 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:41667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:43951
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:43951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38319/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13840
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:41.444342 13840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:41.444556 13840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:41.449323 13846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:41.449323 13848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:41.449443 13840 server_base.cc:1034] running on GCE node
W20260809 03:23:41.449357 13845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:41.449819 13840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:41.450062 13840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:41.451246 13840 hybrid_clock.cc:648] HybridClock initialized: now 1786245821451228 us; error 27 us; skew 500 ppm
I20260809 03:23:41.452559 13840 webserver.cc:460] Webserver started at http://127.8.5.254:33961/ using document root <none> and password file <none>
I20260809 03:23:41.452831 13840 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:41.452905 13840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:41.453056 13840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:41.454087 13840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "a0814926051944a89f9b4042617b9f87"
format_stamp: "Formatted at 2026-08-09 03:23:41 on dist-test-slave-2w3w"
server_key: "79c0617b11917700964f97327248f7ad"
server_key_iv: "853c771d4db9720de7aa19c7248e3bb4"
server_key_version: "encryptionkey@0"
I20260809 03:23:41.454452 13840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "a0814926051944a89f9b4042617b9f87"
format_stamp: "Formatted at 2026-08-09 03:23:41 on dist-test-slave-2w3w"
server_key: "79c0617b11917700964f97327248f7ad"
server_key_iv: "853c771d4db9720de7aa19c7248e3bb4"
server_key_version: "encryptionkey@0"
I20260809 03:23:41.455807 13840 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:23:41.456529 13854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:41.456700 13840 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:23:41.456808 13840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "a0814926051944a89f9b4042617b9f87"
format_stamp: "Formatted at 2026-08-09 03:23:41 on dist-test-slave-2w3w"
server_key: "79c0617b11917700964f97327248f7ad"
server_key_iv: "853c771d4db9720de7aa19c7248e3bb4"
server_key_version: "encryptionkey@0"
I20260809 03:23:41.456892 13840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:41.465844 13840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:41.466150 13840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:41.466305 13840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:41.470360 13840 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:43951
I20260809 03:23:41.470389 13908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:43951 every 8 connection(s)
I20260809 03:23:41.470709 13840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:41.471688 13909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:41.473815 13909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87: Bootstrap starting.
I20260809 03:23:41.474356 13909 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:41.474591 13909 log.cc:824] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:41.475281 13909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87: No bootstrap required, opened a new log
I20260809 03:23:41.475762 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 13840
I20260809 03:23:41.475884 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:23:41.476055 8215 external_mini_cluster.cc:1428] Setting key 53ea4b513bbb5d2abc65bd185862dd87
I20260809 03:23:41.477615 13909 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0814926051944a89f9b4042617b9f87" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43951 } }
I20260809 03:23:41.477741 13909 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:41.477761 13909 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0814926051944a89f9b4042617b9f87, State: Initialized, Role: FOLLOWER
I20260809 03:23:41.477878 13909 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0814926051944a89f9b4042617b9f87" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43951 } }
I20260809 03:23:41.477949 13909 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:41.477970 13909 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:41.478032 13909 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:41.478662 13909 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0814926051944a89f9b4042617b9f87" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43951 } }
I20260809 03:23:41.478761 13909 leader_election.cc:302] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0814926051944a89f9b4042617b9f87; no voters:
I20260809 03:23:41.478920 13909 leader_election.cc:288] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:23:41.478997 13915 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:41.479147 13915 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87 [term 1 LEADER]: Becoming Leader. State: Replica: a0814926051944a89f9b4042617b9f87, State: Running, Role: LEADER
I20260809 03:23:41.479158 13909 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:41.479375 13915 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0814926051944a89f9b4042617b9f87" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43951 } }
I20260809 03:23:41.479764 13917 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0814926051944a89f9b4042617b9f87. Latest consensus state: current_term: 1 leader_uuid: "a0814926051944a89f9b4042617b9f87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0814926051944a89f9b4042617b9f87" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43951 } } }
I20260809 03:23:41.479871 13917 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:41.480068 13924 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:41.480551 13924 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:41.480938 13916 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0814926051944a89f9b4042617b9f87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0814926051944a89f9b4042617b9f87" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43951 } } }
I20260809 03:23:41.481027 13916 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:41.482414 13924 catalog_manager.cc:1347] Generated new cluster ID: 7235080ae0284a48888bb1e73f711c15
I20260809 03:23:41.482455 13914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:41.476521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38468 (local address 127.8.5.254:43951)
0809 03:23:41.476724 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:41.476730 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:41.476755 (+ 25us) server_negotiation.cc:407] Connection header received
0809 03:23:41.477163 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:41.477170 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:41.477221 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:41.477339 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:41.477599 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.478988 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.480197 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.480853 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.480960 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:41.481745 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:41.481748 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:41.481749 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:23:41.481949 (+ 200us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:41.481990 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:23:41.482004 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:41.482070 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:41.482158 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 03:23:41.482237 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":85,"threads_started":1}
I20260809 03:23:41.482467 13924 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:23:41.483335 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:23:41.496999 13924 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:23:41.497490 13924 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:41.504120 13924 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0814926051944a89f9b4042617b9f87: Generated new TSK 0
I20260809 03:23:41.504297 13924 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 03:23:41.527287 13941 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 03:23:41.527361 13941 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 03:23:41.527662 13914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:41.513404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38474 (local address 127.8.5.254:43951)
0809 03:23:41.513450 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:41.513452 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:41.513554 (+ 102us) server_negotiation.cc:407] Connection header received
0809 03:23:41.513604 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:41.513605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:41.513617 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:41.513697 (+ 80us) server_negotiation.cc:226] Negotiated authn=JWT
0809 03:23:41.513813 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.514589 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.515430 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.515762 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.515834 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:41.515980 (+ 146us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 03:23:41.527465 (+ 11485us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38319/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 03:23:41.527597 (+ 132us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38474: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38319/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 03:23:41.527715 13914 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38474: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38319/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260809 03:23:41.527721 13940 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:41.513293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:43951 (local address 127.0.0.1:38474)
0809 03:23:41.513480 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:41.513490 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:41.513552 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:41.513700 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:41.513701 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:41.513702 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0809 03:23:41.513755 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:41.513757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.514676 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.514677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:41.515354 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:41.515357 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.515843 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.515846 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:41.515886 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:41.515890 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 03:23:41.527553 (+ 11663us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38319/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 03:23:41.527638 (+ 85us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.5.254:43951: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38319/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":113,"threads_started":1}
I20260809 03:23:41.528018 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 13840
2026-08-09T03:23:41Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (214 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 03:23:41.567169 8215 mini_oidc.cc:152] Starting JWKS server
I20260809 03:23:41.567893 8215 webserver.cc:460] Webserver started at https://127.0.0.1:39531/ using document root <none> and password file <none>
I20260809 03:23:41.567970 8215 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 03:23:41.568130 8215 webserver.cc:460] Webserver started at http://127.0.0.1:39001/ using document root <none> and password file <none>
2026-08-09T03:23:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:41Z Disabled control of system clock
I20260809 03:23:41.576980 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:43733
--webserver_interface=127.8.5.254
--webserver_port=0
--builtin_ntp_servers=127.8.5.212:33801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:43733
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39531/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 03:23:41.658067 13947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:41.658270 13947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:41.658291 13947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:41.659405 13947 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:41.659440 13947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:41.659452 13947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:41.659466 13947 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:41.659477 13947 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 03:23:41.659489 13947 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 03:23:41.659502 13947 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39531/jwks.json
I20260809 03:23:41.660858 13947 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:33801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:43733
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:43733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39531/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13947
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:41.661064 13947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:41.661291 13947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:41.666013 13955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:41.666047 13953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:41.666046 13952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:41.666255 13947 server_base.cc:1034] running on GCE node
I20260809 03:23:41.666500 13947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:41.666770 13947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:41.667925 13947 hybrid_clock.cc:648] HybridClock initialized: now 1786245821667904 us; error 38 us; skew 500 ppm
I20260809 03:23:41.669169 13947 webserver.cc:460] Webserver started at http://127.8.5.254:43717/ using document root <none> and password file <none>
I20260809 03:23:41.669411 13947 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:41.669482 13947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:41.669636 13947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:41.670697 13947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "9373e82c7f6b4461b91ffa8f95a4f323"
format_stamp: "Formatted at 2026-08-09 03:23:41 on dist-test-slave-2w3w"
server_key: "44922523332ff3371331bfaddc40c6a7"
server_key_iv: "689791113660b6bca1c7879f00b9a204"
server_key_version: "encryptionkey@0"
I20260809 03:23:41.671113 13947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "9373e82c7f6b4461b91ffa8f95a4f323"
format_stamp: "Formatted at 2026-08-09 03:23:41 on dist-test-slave-2w3w"
server_key: "44922523332ff3371331bfaddc40c6a7"
server_key_iv: "689791113660b6bca1c7879f00b9a204"
server_key_version: "encryptionkey@0"
I20260809 03:23:41.672434 13947 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:41.673190 13962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:41.673374 13947 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:41.673475 13947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "9373e82c7f6b4461b91ffa8f95a4f323"
format_stamp: "Formatted at 2026-08-09 03:23:41 on dist-test-slave-2w3w"
server_key: "44922523332ff3371331bfaddc40c6a7"
server_key_iv: "689791113660b6bca1c7879f00b9a204"
server_key_version: "encryptionkey@0"
I20260809 03:23:41.673555 13947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:41.690207 13947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:41.690552 13947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:41.690708 13947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:41.694708 13947 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:43733
I20260809 03:23:41.694826 14015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:43733 every 8 connection(s)
I20260809 03:23:41.695174 13947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:41.696045 14016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:41.698726 14016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323: Bootstrap starting.
I20260809 03:23:41.699337 14016 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:41.699641 14016 log.cc:824] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:41.700330 14016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323: No bootstrap required, opened a new log
I20260809 03:23:41.701579 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 13947
I20260809 03:23:41.701678 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:23:41.701853 8215 external_mini_cluster.cc:1428] Setting key 6eb80f091905d91d391b9587f66aec8d
I20260809 03:23:41.702531 14016 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9373e82c7f6b4461b91ffa8f95a4f323" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43733 } }
I20260809 03:23:41.702677 14016 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:41.702700 14016 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9373e82c7f6b4461b91ffa8f95a4f323, State: Initialized, Role: FOLLOWER
I20260809 03:23:41.702855 14016 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9373e82c7f6b4461b91ffa8f95a4f323" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43733 } }
I20260809 03:23:41.702916 14016 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:41.703002 14016 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:41.703084 14016 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:41.703701 14016 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9373e82c7f6b4461b91ffa8f95a4f323" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43733 } }
I20260809 03:23:41.703795 14016 leader_election.cc:302] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9373e82c7f6b4461b91ffa8f95a4f323; no voters:
I20260809 03:23:41.704016 14016 leader_election.cc:288] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:23:41.704049 14021 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:41.704156 14021 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323 [term 1 LEADER]: Becoming Leader. State: Replica: 9373e82c7f6b4461b91ffa8f95a4f323, State: Running, Role: LEADER
I20260809 03:23:41.704238 14021 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9373e82c7f6b4461b91ffa8f95a4f323" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43733 } }
I20260809 03:23:41.704280 14016 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:41.704562 14021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9373e82c7f6b4461b91ffa8f95a4f323. Latest consensus state: current_term: 1 leader_uuid: "9373e82c7f6b4461b91ffa8f95a4f323" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9373e82c7f6b4461b91ffa8f95a4f323" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43733 } } }
I20260809 03:23:41.704627 14021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:41.704895 14022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9373e82c7f6b4461b91ffa8f95a4f323" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9373e82c7f6b4461b91ffa8f95a4f323" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43733 } } }
I20260809 03:23:41.704963 14022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:41.704972 14025 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:41.705505 14025 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:41.707890 14025 catalog_manager.cc:1347] Generated new cluster ID: a79f6fd4be724f0b8fa2db543a12568d
I20260809 03:23:41.707954 14025 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:23:41.709138 14020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:41.702409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46118 (local address 127.8.5.254:43733)
0809 03:23:41.702623 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:41.702631 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:41.702654 (+ 23us) server_negotiation.cc:407] Connection header received
0809 03:23:41.702779 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:41.702786 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:41.702876 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:41.703104 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:41.703334 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.706103 (+ 2769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.707197 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.707651 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.707753 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:41.708464 (+ 711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:41.708467 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:41.708468 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:23:41.708659 (+ 191us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:41.708697 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:23:41.708710 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:41.708770 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:41.708872 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 03:23:41.708940 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":104,"threads_started":1}
I20260809 03:23:41.715957 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:23:41.747586 14025 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:23:41.748320 14025 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:41.759843 14025 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9373e82c7f6b4461b91ffa8f95a4f323: Generated new TSK 0
I20260809 03:23:41.760032 14025 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:23:41.770336 14020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:41.766660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46128 (local address 127.8.5.254:43733)
0809 03:23:41.766725 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:41.766727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:41.766838 (+ 111us) server_negotiation.cc:407] Connection header received
0809 03:23:41.766891 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:41.766892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:41.766906 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:41.766998 (+ 92us) server_negotiation.cc:226] Negotiated authn=JWT
0809 03:23:41.767131 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.767814 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.768618 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.768901 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.768975 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:41.769138 (+ 163us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 03:23:41.770069 (+ 931us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39531/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 03:23:41.770227 (+ 158us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46128: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39531/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":38}
W20260809 03:23:41.770404 14020 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46128: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39531/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 03:23:41.772284 14046 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:41.766578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:43733 (local address 127.0.0.1:46128)
0809 03:23:41.766758 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:41.766768 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:41.766830 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:41.767000 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:41.767001 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:41.767003 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0809 03:23:41.767061 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:41.767063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.767894 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.767894 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:41.768538 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:41.768540 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.768989 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.768996 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:41.769040 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:41.769044 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 03:23:41.770193 (+ 1149us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39531/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 03:23:41.772193 (+ 2000us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.5.254:43733: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39531/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":1815,"thread_start_us":104,"threads_started":1}
I20260809 03:23:41.772630 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 13947
E20260809 03:23:41.783676 14047 webserver.cc:533] Webserver: sslize failed:
E20260809 03:23:41.783739 14047 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-09T03:23:41Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (246 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T03:23:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:41Z Disabled control of system clock
I20260809 03:23:41.821707 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:40531
--webserver_interface=127.8.5.254
--webserver_port=0
--builtin_ntp_servers=127.8.5.212:39359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:40531
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/testchainca.cert with env {}
W20260809 03:23:41.901571 14051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:41.901795 14051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:41.901844 14051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:41.903054 14051 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:41.903110 14051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:41.903132 14051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:41.903162 14051 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:41.903189 14051 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 03:23:41.903219 14051 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 03:23:41.903245 14051 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 03:23:41.904680 14051 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:40531
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:40531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14051
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:41.904956 14051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:41.905170 14051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:41.909921 14060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:41.909963 14058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:41.909955 14056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:41.910058 14051 server_base.cc:1034] running on GCE node
I20260809 03:23:41.910378 14051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:41.910637 14051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:41.911775 14051 hybrid_clock.cc:648] HybridClock initialized: now 1786245821911750 us; error 40 us; skew 500 ppm
I20260809 03:23:41.913028 14051 webserver.cc:460] Webserver started at http://127.8.5.254:38737/ using document root <none> and password file <none>
I20260809 03:23:41.913267 14051 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:41.913337 14051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:41.913493 14051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:41.914469 14051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "a3a2f1683d0c4a2e8ae4db0cd098c124"
format_stamp: "Formatted at 2026-08-09 03:23:41 on dist-test-slave-2w3w"
server_key: "6df50c25ac3e30f295c029a6c070fdeb"
server_key_iv: "260fd7cdbabaa407a7fe9feaa2b2926a"
server_key_version: "encryptionkey@0"
I20260809 03:23:41.914844 14051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "a3a2f1683d0c4a2e8ae4db0cd098c124"
format_stamp: "Formatted at 2026-08-09 03:23:41 on dist-test-slave-2w3w"
server_key: "6df50c25ac3e30f295c029a6c070fdeb"
server_key_iv: "260fd7cdbabaa407a7fe9feaa2b2926a"
server_key_version: "encryptionkey@0"
I20260809 03:23:41.916153 14051 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:23:41.916893 14066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:41.917079 14051 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:23:41.917178 14051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "a3a2f1683d0c4a2e8ae4db0cd098c124"
format_stamp: "Formatted at 2026-08-09 03:23:41 on dist-test-slave-2w3w"
server_key: "6df50c25ac3e30f295c029a6c070fdeb"
server_key_iv: "260fd7cdbabaa407a7fe9feaa2b2926a"
server_key_version: "encryptionkey@0"
I20260809 03:23:41.917255 14051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:41.926276 14051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:41.926540 14051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:41.926690 14051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:41.930662 14051 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:40531
I20260809 03:23:41.930689 14120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:40531 every 8 connection(s)
I20260809 03:23:41.931143 14051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:41.932070 14121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:41.934253 14121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124: Bootstrap starting.
I20260809 03:23:41.934783 14121 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:41.935127 14121 log.cc:824] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:41.935812 14121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124: No bootstrap required, opened a new log
I20260809 03:23:41.935943 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 14051
I20260809 03:23:41.936072 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:23:41.936277 8215 external_mini_cluster.cc:1428] Setting key 47df260f86141ad8bfea038cea5ad7c1
I20260809 03:23:41.938205 14121 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3a2f1683d0c4a2e8ae4db0cd098c124" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 40531 } }
I20260809 03:23:41.938387 14121 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:41.938428 14121 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3a2f1683d0c4a2e8ae4db0cd098c124, State: Initialized, Role: FOLLOWER
I20260809 03:23:41.938551 14121 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3a2f1683d0c4a2e8ae4db0cd098c124" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 40531 } }
I20260809 03:23:41.938632 14121 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:41.938663 14121 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:41.938709 14121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:41.939476 14121 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3a2f1683d0c4a2e8ae4db0cd098c124" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 40531 } }
I20260809 03:23:41.939585 14121 leader_election.cc:302] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3a2f1683d0c4a2e8ae4db0cd098c124; no voters:
I20260809 03:23:41.939744 14121 leader_election.cc:288] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:23:41.939814 14126 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:41.939960 14126 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124 [term 1 LEADER]: Becoming Leader. State: Replica: a3a2f1683d0c4a2e8ae4db0cd098c124, State: Running, Role: LEADER
I20260809 03:23:41.939976 14121 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:41.940052 14126 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3a2f1683d0c4a2e8ae4db0cd098c124" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 40531 } }
I20260809 03:23:41.940389 14126 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3a2f1683d0c4a2e8ae4db0cd098c124. Latest consensus state: current_term: 1 leader_uuid: "a3a2f1683d0c4a2e8ae4db0cd098c124" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3a2f1683d0c4a2e8ae4db0cd098c124" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 40531 } } }
I20260809 03:23:41.940475 14126 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:41.940411 14128 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3a2f1683d0c4a2e8ae4db0cd098c124" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3a2f1683d0c4a2e8ae4db0cd098c124" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 40531 } } }
I20260809 03:23:41.940557 14128 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:41.940963 14132 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:41.941469 14132 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:41.943087 14132 catalog_manager.cc:1347] Generated new cluster ID: f293cdcb3a754c169d78c1831dc9fd91
I20260809 03:23:41.943146 14132 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:23:41.944018 14125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:41.936786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33996 (local address 127.8.5.254:40531)
0809 03:23:41.936981 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:41.936990 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:41.937025 (+ 35us) server_negotiation.cc:407] Connection header received
0809 03:23:41.938159 (+ 1134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:41.938169 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:41.938250 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:41.938401 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:41.938628 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.940393 (+ 1765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.941574 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.942317 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.942805 (+ 488us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:41.943215 (+ 410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:41.943219 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:41.943219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:23:41.943473 (+ 254us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:41.943516 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:23:41.943530 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:41.943601 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:41.943721 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 03:23:41.943820 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":78,"threads_started":1}
I20260809 03:23:41.945004 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:23:41.957083 14132 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:23:41.957772 14132 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:41.964084 14132 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3a2f1683d0c4a2e8ae4db0cd098c124: Generated new TSK 0
I20260809 03:23:41.964257 14132 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:23:41.984100 14125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:41.975803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33998 (local address 127.8.5.254:40531)
0809 03:23:41.975862 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:41.975864 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:41.975983 (+ 119us) server_negotiation.cc:407] Connection header received
0809 03:23:41.976042 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:41.976043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:41.976055 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:41.976120 (+ 65us) server_negotiation.cc:226] Negotiated authn=JWT
0809 03:23:41.976238 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.977004 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.977711 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.978037 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.978116 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:41.978249 (+ 133us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 03:23:41.983827 (+ 5578us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 03:23:41.984005 (+ 178us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33998: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":36}
W20260809 03:23:41.984130 14151 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:41.975718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:40531 (local address 127.0.0.1:33998)
0809 03:23:41.975906 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:41.975915 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:41.975980 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:41.976124 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:41.976124 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:41.976126 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0809 03:23:41.976181 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:41.976183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.977073 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.977073 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:41.977632 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:41.977634 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:41.978120 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:41.978126 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:41.978163 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:41.978167 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 03:23:41.983962 (+ 5795us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 03:23:41.984056 (+ 94us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.5.254:40531: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":104,"threads_started":1}
W20260809 03:23:41.984177 14125 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33998: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
I20260809 03:23:41.984653 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 14051
2026-08-09T03:23:41Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (190 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (89 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (89 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:23:42 dist-test-slave-2w3w krb5kdc[14163](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:23:42 dist-test-slave-2w3w krb5kdc[14163](info): set up 2 sockets
Aug 09 03:23:42 dist-test-slave-2w3w krb5kdc[14163](info): commencing operation
krb5kdc: starting...
W20260809 03:23:43.235754 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:23:43 dist-test-slave-2w3w krb5kdc[14163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245823, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:23:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:23:43.353145 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:41671
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:32905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:41671
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:43.433607 14179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:43.433846 14179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:43.433887 14179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:43.435086 14179 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:43.435153 14179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:43.435175 14179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:43.435196 14179 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:43.435227 14179 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:23:43.436703 14179 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:32905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:41671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:41671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:43.436982 14179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:43.437216 14179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:43.442076 14184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:43.442107 14187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:43.442112 14185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:43.442085 14179 server_base.cc:1034] running on GCE node
I20260809 03:23:43.442534 14179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:43.442850 14179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:43.444017 14179 hybrid_clock.cc:648] HybridClock initialized: now 1786245823444006 us; error 43 us; skew 500 ppm
Aug 09 03:23:43 dist-test-slave-2w3w krb5kdc[14163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245823, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:43.452244 14179 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:23:43.452644 14179 webserver.cc:460] Webserver started at http://127.8.5.254:43119/ using document root <none> and password file <none>
I20260809 03:23:43.452847 14179 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:43.452888 14179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:43.452975 14179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:43.453979 14179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "1d1b23ac39ad4cee92a13c7abd29a559"
format_stamp: "Formatted at 2026-08-09 03:23:43 on dist-test-slave-2w3w"
server_key: "5de1d46d917436aece9a038ee5b9b19e"
server_key_iv: "e54418bd48bb64a47043f855eba7569e"
server_key_version: "encryptionkey@0"
I20260809 03:23:43.454275 14179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "1d1b23ac39ad4cee92a13c7abd29a559"
format_stamp: "Formatted at 2026-08-09 03:23:43 on dist-test-slave-2w3w"
server_key: "5de1d46d917436aece9a038ee5b9b19e"
server_key_iv: "e54418bd48bb64a47043f855eba7569e"
server_key_version: "encryptionkey@0"
I20260809 03:23:43.455636 14179 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:23:43.456307 14195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:43.456509 14179 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:43.456598 14179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "1d1b23ac39ad4cee92a13c7abd29a559"
format_stamp: "Formatted at 2026-08-09 03:23:43 on dist-test-slave-2w3w"
server_key: "5de1d46d917436aece9a038ee5b9b19e"
server_key_iv: "e54418bd48bb64a47043f855eba7569e"
server_key_version: "encryptionkey@0"
I20260809 03:23:43.456651 14179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:43.480223 14179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:43.482501 14179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:43.482612 14179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:43.486634 14179 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:41671
I20260809 03:23:43.486734 14249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:41671 every 8 connection(s)
I20260809 03:23:43.487107 14179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:43.487872 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 14179
I20260809 03:23:43.487990 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:23:43.488185 8215 external_mini_cluster.cc:1428] Setting key 77cbfe47bb5e1c84e4b029a4cf939bb4
I20260809 03:23:43.488237 14250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:43.491740 14250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559: Bootstrap starting.
I20260809 03:23:43.492440 14250 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:43.492744 14250 log.cc:824] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:43.493577 14250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559: No bootstrap required, opened a new log
Aug 09 03:23:43 dist-test-slave-2w3w krb5kdc[14163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245823, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:43.495867 14250 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d1b23ac39ad4cee92a13c7abd29a559" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 41671 } }
I20260809 03:23:43.496024 14250 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:43.496073 14250 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d1b23ac39ad4cee92a13c7abd29a559, State: Initialized, Role: FOLLOWER
I20260809 03:23:43.496243 14250 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d1b23ac39ad4cee92a13c7abd29a559" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 41671 } }
I20260809 03:23:43.496340 14250 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:43.496387 14250 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:43.496435 14250 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:43.497175 14250 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d1b23ac39ad4cee92a13c7abd29a559" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 41671 } }
I20260809 03:23:43.497287 14250 leader_election.cc:302] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d1b23ac39ad4cee92a13c7abd29a559; no voters:
I20260809 03:23:43.497448 14250 leader_election.cc:288] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:23:43.497509 14256 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:43.497656 14256 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559 [term 1 LEADER]: Becoming Leader. State: Replica: 1d1b23ac39ad4cee92a13c7abd29a559, State: Running, Role: LEADER
I20260809 03:23:43.497709 14250 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:43.497779 14256 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d1b23ac39ad4cee92a13c7abd29a559" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 41671 } }
I20260809 03:23:43.498127 14258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d1b23ac39ad4cee92a13c7abd29a559" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d1b23ac39ad4cee92a13c7abd29a559" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 41671 } } }
I20260809 03:23:43.498121 14256 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d1b23ac39ad4cee92a13c7abd29a559. Latest consensus state: current_term: 1 leader_uuid: "1d1b23ac39ad4cee92a13c7abd29a559" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d1b23ac39ad4cee92a13c7abd29a559" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 41671 } } }
I20260809 03:23:43.498257 14258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:43.498268 14256 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:43.498520 14264 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:43.499058 14264 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:43.499863 14253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:43.488749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40172 (local address 127.8.5.254:41671)
0809 03:23:43.488947 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:43.488959 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:43.488988 (+ 29us) server_negotiation.cc:407] Connection header received
0809 03:23:43.489374 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:43.489381 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:43.489424 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:43.489536 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:43.490333 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:43.491334 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:43.492372 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:43.492846 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:43.492927 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:43.495489 (+ 2562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:43.495493 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:43.495493 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:43.495502 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:43.497612 (+ 2110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:43.497995 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:43.497998 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:43.497999 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:43.498102 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:43.498440 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:43.498440 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:43.498441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:43.498765 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:43.499423 (+ 658us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:43.499499 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 03:23:43.499637 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":101,"threads_started":1}
I20260809 03:23:43.503679 14264 catalog_manager.cc:1347] Generated new cluster ID: 647a716008384b07819d0f2df616013c
I20260809 03:23:43.503738 14264 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:23:43.517143 14264 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:23:43.517637 14264 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:43.526180 14264 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d1b23ac39ad4cee92a13c7abd29a559: Generated new TSK 0
I20260809 03:23:43.526378 14264 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
I20260809 03:23:43.558250 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:41671
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:32905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:43.658694 14278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:43.658913 14278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:43.658937 14278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:43.660310 14278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:43.660356 14278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:43.660383 14278 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:23:43.661902 14278 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:32905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:41671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14278
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:43.662154 14278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:43.662371 14278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:43.667349 14284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:43.667479 14278 server_base.cc:1034] running on GCE node
W20260809 03:23:43.667335 14286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:43.667574 14283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:43.667806 14278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:43.667999 14278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:43.669162 14278 hybrid_clock.cc:648] HybridClock initialized: now 1786245823669146 us; error 26 us; skew 500 ppm
Aug 09 03:23:43 dist-test-slave-2w3w krb5kdc[14163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245823, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:43.671862 14278 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:23:43.672572 14278 webserver.cc:460] Webserver started at http://127.8.5.193:46019/ using document root <none> and password file <none>
I20260809 03:23:43.672937 14278 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:43.673034 14278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:43.673188 14278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:43.674410 14278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "967c870b00d24310a3e44c01671a7b1b"
format_stamp: "Formatted at 2026-08-09 03:23:43 on dist-test-slave-2w3w"
server_key: "47efa731fd72cd2f59bc6960ef44fe06"
server_key_iv: "f1565c02a4553f7b160a370683da4b9c"
server_key_version: "encryptionkey@0"
I20260809 03:23:43.674842 14278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "967c870b00d24310a3e44c01671a7b1b"
format_stamp: "Formatted at 2026-08-09 03:23:43 on dist-test-slave-2w3w"
server_key: "47efa731fd72cd2f59bc6960ef44fe06"
server_key_iv: "f1565c02a4553f7b160a370683da4b9c"
server_key_version: "encryptionkey@0"
I20260809 03:23:43.676740 14278 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260809 03:23:43.677547 14293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:43.677718 14278 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:43.677856 14278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "967c870b00d24310a3e44c01671a7b1b"
format_stamp: "Formatted at 2026-08-09 03:23:43 on dist-test-slave-2w3w"
server_key: "47efa731fd72cd2f59bc6960ef44fe06"
server_key_iv: "f1565c02a4553f7b160a370683da4b9c"
server_key_version: "encryptionkey@0"
I20260809 03:23:43.677948 14278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:43.703598 14278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:43.705643 14278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:43.705837 14278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:43.706106 14278 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:43.706458 14278 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:43.706518 14278 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:43.706563 14278 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:43.706615 14278 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:43.712905 14278 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:34051
I20260809 03:23:43.712961 14411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:34051 every 8 connection(s)
I20260809 03:23:43.713300 14278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:23:43.714476 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 14278
I20260809 03:23:43.714602 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:23:43.714797 8215 external_mini_cluster.cc:1428] Setting key 6dc58d1bd758e7057396434ac56ed42c
Aug 09 03:23:43 dist-test-slave-2w3w krb5kdc[14163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245823, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:43.723802 14253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:43.714002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:60053 (local address 127.8.5.254:41671)
0809 03:23:43.714048 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:43.714051 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:43.714247 (+ 196us) server_negotiation.cc:407] Connection header received
0809 03:23:43.715463 (+ 1216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:43.715464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:43.715478 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:43.715529 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:43.716217 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:43.716735 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:43.717708 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:43.717935 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:43.718012 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:43.720535 (+ 2523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:43.720536 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:43.720536 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:43.720545 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:43.722208 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:43.722663 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:43.722664 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:43.722665 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:43.722737 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:43.723063 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:43.723064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:43.723064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:43.723231 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:43.723313 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:43.723596 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 03:23:43.723691 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:23:43.723806 14414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:43.713967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:41671 (local address 127.8.5.193:60053)
0809 03:23:43.714132 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:43.714174 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:43.715338 (+ 1164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:43.715659 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:43.715670 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:43.715924 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:43.716113 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:43.716117 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:43.716831 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:43.716833 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:43.717613 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:43.717615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:43.718020 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:43.718021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:43.718152 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:43.718666 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:43.718676 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:43.720433 (+ 1757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:43.722305 (+ 1872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:43.722313 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:43.722314 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:43.722564 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:43.722836 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:43.722837 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:43.722837 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:43.722952 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:43.723311 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:43.723318 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:43.723453 (+ 135us) client_negotiation.cc:769] Sending connection context
0809 03:23:43.723530 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 03:23:43.723648 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":98,"threads_started":1}
I20260809 03:23:43.724416 14412 heartbeater.cc:347] Connected to a master server at 127.8.5.254:41671
I20260809 03:23:43.724516 14412 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.8.5.194@KRBTEST.COM; defaulting to no policy
I20260809 03:23:43.724720 14412 heartbeater.cc:511] Master 127.8.5.254:41671 requested a full tablet report, sending...
I20260809 03:23:43.725335 14213 ts_manager.cc:194] Registered new tserver with Master: 967c870b00d24310a3e44c01671a7b1b (127.8.5.193:34051)
I20260809 03:23:43.725955 14213 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:60053
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
I20260809 03:23:43.742389 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:41671
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:32905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:43.825174 14417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:43.825398 14417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:43.825433 14417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:43.826591 14417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:43.826664 14417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:43.826711 14417 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:23:43.828220 14417 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:32905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:41671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:43.828485 14417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:43.828701 14417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:43.833669 14423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:43.833690 14425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:43.833727 14422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:43.834018 14417 server_base.cc:1034] running on GCE node
I20260809 03:23:43.834177 14417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:43.834380 14417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:43.835529 14417 hybrid_clock.cc:648] HybridClock initialized: now 1786245823835514 us; error 28 us; skew 500 ppm
Aug 09 03:23:43 dist-test-slave-2w3w krb5kdc[14163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245823, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:43.838101 14417 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:23:43.838518 14417 webserver.cc:460] Webserver started at http://127.8.5.194:40049/ using document root <none> and password file <none>
I20260809 03:23:43.838742 14417 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:43.838810 14417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:43.838951 14417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:43.839995 14417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "3fa1a725bdbe4c86b370aaaa28381e6e"
format_stamp: "Formatted at 2026-08-09 03:23:43 on dist-test-slave-2w3w"
server_key: "340d0139335d40cbdb12301ef2a63929"
server_key_iv: "8af1f1f3e4b38037406c0367634737c5"
server_key_version: "encryptionkey@0"
I20260809 03:23:43.840289 14417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "3fa1a725bdbe4c86b370aaaa28381e6e"
format_stamp: "Formatted at 2026-08-09 03:23:43 on dist-test-slave-2w3w"
server_key: "340d0139335d40cbdb12301ef2a63929"
server_key_iv: "8af1f1f3e4b38037406c0367634737c5"
server_key_version: "encryptionkey@0"
I20260809 03:23:43.841528 14417 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 03:23:43.842195 14432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:43.842377 14417 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:23:43.842445 14417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "3fa1a725bdbe4c86b370aaaa28381e6e"
format_stamp: "Formatted at 2026-08-09 03:23:43 on dist-test-slave-2w3w"
server_key: "340d0139335d40cbdb12301ef2a63929"
server_key_iv: "8af1f1f3e4b38037406c0367634737c5"
server_key_version: "encryptionkey@0"
I20260809 03:23:43.842494 14417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:43.858605 14417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:43.860630 14417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:43.860780 14417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:43.861023 14417 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:43.861330 14417 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:43.861364 14417 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:43.861415 14417 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:43.861443 14417 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:43.867208 14417 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:34331
I20260809 03:23:43.867254 14551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:34331 every 8 connection(s)
I20260809 03:23:43.867548 14417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
Aug 09 03:23:43 dist-test-slave-2w3w krb5kdc[14163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245823, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:43.876972 14253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:43.868193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:35609 (local address 127.8.5.254:41671)
0809 03:23:43.868256 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:43.868258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:43.868459 (+ 201us) server_negotiation.cc:407] Connection header received
0809 03:23:43.869532 (+ 1073us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:43.869533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:43.869547 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:43.869614 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:43.870216 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:43.870728 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:43.871826 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:43.872045 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:43.872126 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:43.874251 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:43.874252 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:43.874253 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:43.874261 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:43.875539 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:43.875937 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:43.875939 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:43.875939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:43.876024 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:43.876282 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:43.876283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:43.876283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:43.876403 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:43.876508 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:43.876776 (+ 268us) server_negotiation.cc:299] Negotiation successful
0809 03:23:43.876858 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 03:23:43.877154 14555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:43.868164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:41671 (local address 127.8.5.194:35609)
0809 03:23:43.868344 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:43.868379 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:43.869405 (+ 1026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:43.869683 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:43.869691 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:43.869934 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:43.870117 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:43.870121 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:43.870827 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:43.870828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:43.871729 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:43.871732 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:43.872133 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:43.872134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:43.872258 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:43.872776 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:43.872785 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:43.874150 (+ 1365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:43.875634 (+ 1484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:43.875641 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:43.875643 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:43.875858 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:43.876094 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:43.876095 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:43.876095 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:43.876204 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:43.876501 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:43.876508 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:43.876646 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 03:23:43.876755 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 03:23:43.876933 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":91,"threads_started":1}
I20260809 03:23:43.877578 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 14417
I20260809 03:23:43.877699 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:23:43.877688 14552 heartbeater.cc:347] Connected to a master server at 127.8.5.254:41671
I20260809 03:23:43.877774 14552 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:43.877895 8215 external_mini_cluster.cc:1428] Setting key 1e272b1319776ae1f1381a34d88c1303
I20260809 03:23:43.877960 14552 heartbeater.cc:511] Master 127.8.5.254:41671 requested a full tablet report, sending...
I20260809 03:23:43.878372 14212 ts_manager.cc:194] Registered new tserver with Master: 3fa1a725bdbe4c86b370aaaa28381e6e (127.8.5.194:34331)
I20260809 03:23:43.878772 14212 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:35609
WARNING: no policy specified for kudu/127.8.5.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
I20260809 03:23:43.903038 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:41671
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:32905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:43.985976 14558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:43.986195 14558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:43.986222 14558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:43.987465 14558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:43.987505 14558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:43.987534 14558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:23:43.989152 14558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:32905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:41671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:43.989348 14558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:43.989548 14558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:43.994839 14564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:43.994863 14567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:43.994881 14558 server_base.cc:1034] running on GCE node
W20260809 03:23:43.995504 14565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:43.995759 14558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:43.996045 14558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:43.997203 14558 hybrid_clock.cc:648] HybridClock initialized: now 1786245823997200 us; error 37 us; skew 500 ppm
Aug 09 03:23:43 dist-test-slave-2w3w krb5kdc[14163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245823, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:44.000145 14558 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:23:44.000523 14558 webserver.cc:460] Webserver started at http://127.8.5.195:36757/ using document root <none> and password file <none>
I20260809 03:23:44.000720 14558 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:44.000761 14558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:44.000849 14558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:44.001811 14558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "fc43b34abb1b44d6a8a45f43e5319ef2"
format_stamp: "Formatted at 2026-08-09 03:23:43 on dist-test-slave-2w3w"
server_key: "ccee0573e52937f2aae2f265e18813af"
server_key_iv: "bcd64648037d29b6d4394c78b538e2b8"
server_key_version: "encryptionkey@0"
I20260809 03:23:44.002110 14558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "fc43b34abb1b44d6a8a45f43e5319ef2"
format_stamp: "Formatted at 2026-08-09 03:23:43 on dist-test-slave-2w3w"
server_key: "ccee0573e52937f2aae2f265e18813af"
server_key_iv: "bcd64648037d29b6d4394c78b538e2b8"
server_key_version: "encryptionkey@0"
I20260809 03:23:44.003481 14558 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:23:44.004197 14574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:44.004453 14558 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 03:23:44.004530 14558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "fc43b34abb1b44d6a8a45f43e5319ef2"
format_stamp: "Formatted at 2026-08-09 03:23:43 on dist-test-slave-2w3w"
server_key: "ccee0573e52937f2aae2f265e18813af"
server_key_iv: "bcd64648037d29b6d4394c78b538e2b8"
server_key_version: "encryptionkey@0"
I20260809 03:23:44.004581 14558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:44.029142 14558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:44.031387 14558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:44.031502 14558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:44.031687 14558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:44.031935 14558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:44.031967 14558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:44.031989 14558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:44.032001 14558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:44.037741 14558 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:43189
I20260809 03:23:44.037832 14695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:43189 every 8 connection(s)
I20260809 03:23:44.038130 14558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
Aug 09 03:23:44 dist-test-slave-2w3w krb5kdc[14163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245823, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:44.047098 14253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:44.038878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:40265 (local address 127.8.5.254:41671)
0809 03:23:44.038935 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:44.038937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:44.039164 (+ 227us) server_negotiation.cc:407] Connection header received
0809 03:23:44.040087 (+ 923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:44.040088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:44.040098 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:44.040164 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:44.040703 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:44.041195 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:44.042142 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:44.042335 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:44.042384 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:44.044392 (+ 2008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:44.044394 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:44.044395 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:44.044403 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:44.045837 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:44.046270 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:44.046271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:44.046272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:44.046332 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:44.046553 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:44.046553 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:44.046554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:44.046642 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:44.046686 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:44.046903 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 03:23:44.047025 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 03:23:44.047231 14698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:44.038844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:41671 (local address 127.8.5.195:40265)
0809 03:23:44.039031 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:44.039083 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:44.039996 (+ 913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:44.040215 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:44.040218 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:44.040454 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:44.040636 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:44.040639 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:44.041272 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:44.041273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:44.042072 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:44.042074 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:44.042406 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:44.042406 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:44.042500 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:44.042910 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:44.042918 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:44.044263 (+ 1345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:44.045904 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:44.045910 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:44.045911 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:44.046219 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:44.046388 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:44.046389 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:44.046389 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:44.046505 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:44.046693 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:44.046697 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:44.046802 (+ 105us) client_negotiation.cc:769] Sending connection context
0809 03:23:44.046894 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 03:23:44.047032 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":116,"threads_started":1}
I20260809 03:23:44.047719 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 14558
I20260809 03:23:44.047739 14696 heartbeater.cc:347] Connected to a master server at 127.8.5.254:41671
I20260809 03:23:44.047837 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:23:44.047860 14696 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:44.048035 8215 external_mini_cluster.cc:1428] Setting key e6c42f59cf031dd880c8d84fcba23985
I20260809 03:23:44.048036 14696 heartbeater.cc:511] Master 127.8.5.254:41671 requested a full tablet report, sending...
I20260809 03:23:44.048539 14212 ts_manager.cc:194] Registered new tserver with Master: fc43b34abb1b44d6a8a45f43e5319ef2 (127.8.5.195:43189)
I20260809 03:23:44.048950 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:23:44.048969 14212 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:40265
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/test-admin.keytab.
Aug 09 03:23:44 dist-test-slave-2w3w krb5kdc[14163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:44.065402 8215 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 03:23:44.067158 14703 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:44.066284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33750 (local address 127.8.5.193:34051)
0809 03:23:44.066467 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:44.066471 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:44.066481 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:23:44.066507 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:44.066509 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:44.066522 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:44.066595 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:44.067069 (+ 474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33750: BlockingRecv error: recv got EOF from 127.0.0.1:33750 (error 108)
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":102,"threads_started":1}
W20260809 03:23:44.067239 8215 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/krb5cc' of type FILE
Aug 09 03:23:44 dist-test-slave-2w3w krb5kdc[14163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:44.068222 8215 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 03:23:44 dist-test-slave-2w3w krb5kdc[14163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:44.069067 8215 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 03:23:44 dist-test-slave-2w3w krb5kdc[14163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.193@KRBTEST.COM
I20260809 03:23:44.076504 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:44.069543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33766 (local address 127.8.5.193:34051)
0809 03:23:44.069594 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:44.069596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:44.069618 (+ 22us) server_negotiation.cc:407] Connection header received
0809 03:23:44.069678 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:44.069678 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:44.069688 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:44.069735 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:44.070107 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:44.070831 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:44.071560 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:44.071871 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:44.071929 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:44.073856 (+ 1927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:44.073864 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:44.073864 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:44.073870 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:44.075536 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:44.075828 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:44.075831 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:44.075831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:44.075882 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:44.076037 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:44.076037 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:44.076037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:44.076138 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:44.076224 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:44.076287 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 03:23:44.076378 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
W20260809 03:23:44.078303 14703 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:44.077664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33772 (local address 127.8.5.193:34051)
0809 03:23:44.077724 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:44.077726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:44.077794 (+ 68us) server_negotiation.cc:407] Connection header received
0809 03:23:44.077897 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:44.077898 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:44.077909 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:44.077962 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:44.078255 (+ 293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33772: BlockingRecv error: recv got EOF from 127.0.0.1:33772 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260809 03:23:44.078382 8215 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/krb5cc' of type FILE
Aug 09 03:23:44 dist-test-slave-2w3w krb5kdc[14163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:44.079304 8215 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 03:23:44 dist-test-slave-2w3w krb5kdc[14163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:44.080153 8215 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 03:23:44 dist-test-slave-2w3w krb5kdc[14163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.193@KRBTEST.COM
I20260809 03:23:44.086812 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:44.080700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33776 (local address 127.8.5.193:34051)
0809 03:23:44.080755 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:44.080757 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:44.080767 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:23:44.080845 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:44.080846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:44.080854 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:44.080911 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:44.081264 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:44.081778 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:44.082431 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:44.082630 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:44.082708 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:44.084597 (+ 1889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:44.084598 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:44.084598 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:44.084606 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:44.085726 (+ 1120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:44.086067 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:44.086068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:44.086069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:44.086126 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:44.086324 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:44.086325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:44.086325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:44.086427 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:44.086525 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:44.086644 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 03:23:44.086712 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260809 03:23:44.088249 14703 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:44.087774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33788 (local address 127.8.5.193:34051)
0809 03:23:44.087811 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:44.087813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:44.087844 (+ 31us) server_negotiation.cc:407] Connection header received
0809 03:23:44.087908 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:44.087908 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:44.087915 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:44.087956 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:44.088199 (+ 243us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33788: BlockingRecv error: recv got EOF from 127.0.0.1:33788 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 03:23:44.088297 8215 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786245797426041-8215-0/krb5kdc/krb5cc' of type FILE
Aug 09 03:23:44 dist-test-slave-2w3w krb5kdc[14163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:44.089179 8215 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 03:23:44 dist-test-slave-2w3w krb5kdc[14163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:44.089989 8215 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 03:23:44 dist-test-slave-2w3w krb5kdc[14163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.193@KRBTEST.COM
I20260809 03:23:44.096372 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:44.090446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33802 (local address 127.8.5.193:34051)
0809 03:23:44.090500 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:44.090502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:44.090510 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:23:44.090567 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:44.090568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:44.090575 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:44.090617 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:44.090938 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:44.091430 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:44.092064 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:44.092239 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:44.092295 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:44.094084 (+ 1789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:44.094085 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:44.094086 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:44.094092 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:44.095463 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:44.095739 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:44.095740 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:44.095740 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:44.095792 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:44.095955 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:44.095955 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:44.095955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:44.096027 (+ 72us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:44.096088 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:44.096172 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 03:23:44.096221 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 03:23:44.097005 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 14278
I20260809 03:23:44.103901 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 14417
I20260809 03:23:44.111438 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 14558
I20260809 03:23:44.116241 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 14179
2026-08-09T03:23:44Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1953 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:23:44 dist-test-slave-2w3w krb5kdc[14716](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:23:44 dist-test-slave-2w3w krb5kdc[14716](info): set up 2 sockets
Aug 09 03:23:44 dist-test-slave-2w3w krb5kdc[14716](info): commencing operation
krb5kdc: starting...
W20260809 03:23:45.205760 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:23:45 dist-test-slave-2w3w krb5kdc[14716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:23:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:45Z Disabled control of system clock
WARNING: no policy specified for oryx/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.254.keytab.
Entry for principal oryx/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.254.keytab.
I20260809 03:23:45.326030 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:33131
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.254.keytab
--principal=oryx/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:42821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:33131
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:45.406023 14729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:45.406275 14729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:45.406316 14729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:45.407478 14729 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:45.407549 14729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:45.407575 14729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:45.407603 14729 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:45.407634 14729 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:23:45.409091 14729 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:42821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:33131
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.254.keytab
--principal=oryx/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:33131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:45.409379 14729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:45.409605 14729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:45.414418 14737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:45.414407 14734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:45.414438 14735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:45.414511 14729 server_base.cc:1034] running on GCE node
I20260809 03:23:45.414866 14729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:45.415207 14729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:45.416389 14729 hybrid_clock.cc:648] HybridClock initialized: now 1786245825416364 us; error 38 us; skew 500 ppm
Aug 09 03:23:45 dist-test-slave-2w3w krb5kdc[14716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245825, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:45.419021 14729 init.cc:377] Logged in from keytab as oryx/127.8.5.254@KRBTEST.COM (short username oryx)
I20260809 03:23:45.419471 14729 webserver.cc:460] Webserver started at http://127.8.5.254:37797/ using document root <none> and password file <none>
I20260809 03:23:45.419664 14729 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:45.419704 14729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:45.419798 14729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:45.420776 14729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "775fc7fbd9ce4ed98bcff9377b58c161"
format_stamp: "Formatted at 2026-08-09 03:23:45 on dist-test-slave-2w3w"
server_key: "06ec3c0e36f5249afac7ba4346312c95"
server_key_iv: "710550578ac82b137b3fdbeee4e17877"
server_key_version: "encryptionkey@0"
I20260809 03:23:45.421080 14729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "775fc7fbd9ce4ed98bcff9377b58c161"
format_stamp: "Formatted at 2026-08-09 03:23:45 on dist-test-slave-2w3w"
server_key: "06ec3c0e36f5249afac7ba4346312c95"
server_key_iv: "710550578ac82b137b3fdbeee4e17877"
server_key_version: "encryptionkey@0"
I20260809 03:23:45.422302 14729 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:23:45.422992 14744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:45.423202 14729 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:45.423323 14729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "775fc7fbd9ce4ed98bcff9377b58c161"
format_stamp: "Formatted at 2026-08-09 03:23:45 on dist-test-slave-2w3w"
server_key: "06ec3c0e36f5249afac7ba4346312c95"
server_key_iv: "710550578ac82b137b3fdbeee4e17877"
server_key_version: "encryptionkey@0"
I20260809 03:23:45.423414 14729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:45.434535 14729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:45.436467 14729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:45.436630 14729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:45.440944 14729 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:33131
I20260809 03:23:45.441046 14799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:33131 every 8 connection(s)
I20260809 03:23:45.441347 14729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:45.442281 14800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:45.444572 14800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161: Bootstrap starting.
I20260809 03:23:45.445137 14800 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:45.445451 14800 log.cc:824] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:45.446190 14800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161: No bootstrap required, opened a new log
I20260809 03:23:45.447964 14800 raft_consensus.cc:348] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } }
I20260809 03:23:45.448094 14800 raft_consensus.cc:374] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:45.448137 14800 raft_consensus.cc:729] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 775fc7fbd9ce4ed98bcff9377b58c161, State: Initialized, Role: FOLLOWER
I20260809 03:23:45.448287 14800 consensus_queue.cc:260] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } }
I20260809 03:23:45.448378 14800 raft_consensus.cc:388] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:45.448402 14800 raft_consensus.cc:482] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:45.448457 14800 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:45.449239 14800 raft_consensus.cc:504] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } }
I20260809 03:23:45.449358 14800 leader_election.cc:302] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 775fc7fbd9ce4ed98bcff9377b58c161; no voters:
I20260809 03:23:45.449536 14800 leader_election.cc:288] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:23:45.449573 14803 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:45.449740 14803 raft_consensus.cc:686] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [term 1 LEADER]: Becoming Leader. State: Replica: 775fc7fbd9ce4ed98bcff9377b58c161, State: Running, Role: LEADER
I20260809 03:23:45.449795 14800 sys_catalog.cc:564] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:45.449900 14803 consensus_queue.cc:237] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } }
I20260809 03:23:45.450327 14807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 775fc7fbd9ce4ed98bcff9377b58c161. Latest consensus state: current_term: 1 leader_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } }
I20260809 03:23:45.450440 14807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:45.450681 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 14729
I20260809 03:23:45.450847 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:23:45.450307 14804 sys_catalog.cc:455] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } }
I20260809 03:23:45.450903 14804 sys_catalog.cc:458] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:45.451159 8215 external_mini_cluster.cc:1428] Setting key 2cc616241cdf0eb0d0ed90696c1b06bf
W20260809 03:23:45.451627 14821 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:23:45.451675 14821 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:23:45.451794 14814 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:45.451977 14814 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:45.453485 14814 catalog_manager.cc:1347] Generated new cluster ID: 384b17053f054eb2bbf5395ea2d70ae2
I20260809 03:23:45.453540 14814 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 03:23:45 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM
I20260809 03:23:45.462489 14824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:45.451624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53214 (local address 127.8.5.254:33131)
0809 03:23:45.451797 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:45.451806 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:45.451869 (+ 63us) server_negotiation.cc:407] Connection header received
0809 03:23:45.452045 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:45.452052 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:45.452106 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:45.452256 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:45.452968 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:45.454320 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:45.455434 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:45.456041 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:45.456135 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:45.458811 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:45.458815 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:45.458815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:45.458827 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:45.460856 (+ 2029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:45.461240 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:45.461243 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:45.461243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:45.461376 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:45.461583 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:45.461584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:45.461584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:45.461895 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:45.462049 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:45.462126 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 03:23:45.462265 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":77,"threads_started":1}
I20260809 03:23:45.464107 14814 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:23:45.464576 14814 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:45.469452 14814 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161: Generated new TSK 0
I20260809 03:23:45.469640 14814 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.193.keytab.
Entry for principal oryx/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.193.keytab.
I20260809 03:23:45.496124 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33131
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.193.keytab
--principal=oryx/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:42821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:45.577180 14828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:45.577373 14828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:45.577395 14828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:45.578513 14828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:45.578553 14828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:45.578605 14828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:23:45.580057 14828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:42821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.193.keytab
--principal=oryx/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:45.580295 14828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:45.580539 14828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:45.585354 14835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:45.585367 14834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:45.585386 14837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:45.585537 14828 server_base.cc:1034] running on GCE node
I20260809 03:23:45.585851 14828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:45.586066 14828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:45.587232 14828 hybrid_clock.cc:648] HybridClock initialized: now 1786245825587203 us; error 48 us; skew 500 ppm
Aug 09 03:23:45 dist-test-slave-2w3w krb5kdc[14716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245825, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:45.590098 14828 init.cc:377] Logged in from keytab as oryx/127.8.5.193@KRBTEST.COM (short username oryx)
I20260809 03:23:45.590528 14828 webserver.cc:460] Webserver started at http://127.8.5.193:45483/ using document root <none> and password file <none>
I20260809 03:23:45.590760 14828 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:45.590829 14828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:45.591027 14828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:45.592074 14828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "73eaa15098d547f5ac2372300461ef7e"
format_stamp: "Formatted at 2026-08-09 03:23:45 on dist-test-slave-2w3w"
server_key: "7bb3fa73f29d59b71193f4ab79dc8af2"
server_key_iv: "a5cdb83d3f86b43f59a96bef04257161"
server_key_version: "encryptionkey@0"
I20260809 03:23:45.592447 14828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "73eaa15098d547f5ac2372300461ef7e"
format_stamp: "Formatted at 2026-08-09 03:23:45 on dist-test-slave-2w3w"
server_key: "7bb3fa73f29d59b71193f4ab79dc8af2"
server_key_iv: "a5cdb83d3f86b43f59a96bef04257161"
server_key_version: "encryptionkey@0"
I20260809 03:23:45.593781 14828 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:23:45.594750 14844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:45.594949 14828 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:45.595057 14828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "73eaa15098d547f5ac2372300461ef7e"
format_stamp: "Formatted at 2026-08-09 03:23:45 on dist-test-slave-2w3w"
server_key: "7bb3fa73f29d59b71193f4ab79dc8af2"
server_key_iv: "a5cdb83d3f86b43f59a96bef04257161"
server_key_version: "encryptionkey@0"
I20260809 03:23:45.595131 14828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:45.625427 14828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:45.627662 14828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:45.627833 14828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:45.628087 14828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:45.628409 14828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:45.628468 14828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:45.628511 14828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:45.628539 14828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:45.634287 14828 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:33243
I20260809 03:23:45.634390 14964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:33243 every 8 connection(s)
I20260809 03:23:45.634691 14828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
Aug 09 03:23:45 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245825, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM
I20260809 03:23:45.641225 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 14828
I20260809 03:23:45.641342 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:23:45.641577 8215 external_mini_cluster.cc:1428] Setting key 5199d059d8b7739d3bb9de8153f6a0d8
I20260809 03:23:45.644425 14824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:45.635477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:39489 (local address 127.8.5.254:33131)
0809 03:23:45.635548 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:45.635551 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:45.635777 (+ 226us) server_negotiation.cc:407] Connection header received
0809 03:23:45.636246 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:45.636247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:45.636260 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:45.636307 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:45.637225 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:45.637740 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:45.638675 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:45.638873 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:45.638923 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:45.641173 (+ 2250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:45.641174 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:45.641174 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:45.641215 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:45.642830 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:45.643355 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:45.643356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:45.643356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:45.643406 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:45.643667 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:45.643668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:45.643668 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:45.643773 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:45.643818 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:45.644192 (+ 374us) server_negotiation.cc:299] Negotiation successful
0809 03:23:45.644291 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 03:23:45.644572 14967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:45.635471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.193:39489)
0809 03:23:45.635658 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:45.635693 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:45.636167 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:45.636369 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:45.636372 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:45.636920 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:45.637104 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:45.637108 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:45.637822 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:45.637823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:45.638598 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:45.638600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:45.638946 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:45.638947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:45.639061 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:45.639560 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:45.639567 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:45.641081 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:45.642920 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:45.642928 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:45.642929 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:45.643288 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:45.643462 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:45.643463 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:45.643463 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:45.643605 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:45.643841 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:45.643847 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:45.644025 (+ 178us) client_negotiation.cc:769] Sending connection context
0809 03:23:45.644143 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 03:23:45.644320 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":107,"threads_started":1}
I20260809 03:23:45.645094 14965 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33131
I20260809 03:23:45.645229 14965 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:45.645444 14965 heartbeater.cc:511] Master 127.8.5.254:33131 requested a full tablet report, sending...
I20260809 03:23:45.645951 14761 ts_manager.cc:194] Registered new tserver with Master: 73eaa15098d547f5ac2372300461ef7e (127.8.5.193:33243)
I20260809 03:23:45.646543 14761 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:39489
WARNING: no policy specified for oryx/127.8.5.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.194.keytab.
Entry for principal oryx/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.194.keytab.
I20260809 03:23:45.667634 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33131
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.194.keytab
--principal=oryx/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:42821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:45.748531 14970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:45.748735 14970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:45.748760 14970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:45.749902 14970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:45.749941 14970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:45.750016 14970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:23:45.751605 14970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:42821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.194.keytab
--principal=oryx/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:45.751799 14970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:45.751978 14970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:45.756968 14976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:45.756991 14978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:45.756991 14975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:45.757236 14970 server_base.cc:1034] running on GCE node
I20260809 03:23:45.757472 14970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:45.757717 14970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:45.758913 14970 hybrid_clock.cc:648] HybridClock initialized: now 1786245825758897 us; error 26 us; skew 500 ppm
Aug 09 03:23:45 dist-test-slave-2w3w krb5kdc[14716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245825, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:45.761583 14970 init.cc:377] Logged in from keytab as oryx/127.8.5.194@KRBTEST.COM (short username oryx)
I20260809 03:23:45.762104 14970 webserver.cc:460] Webserver started at http://127.8.5.194:36877/ using document root <none> and password file <none>
I20260809 03:23:45.762327 14970 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:45.762396 14970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:45.762549 14970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:45.763650 14970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "c1b9e89fd789450384d19508e2a23094"
format_stamp: "Formatted at 2026-08-09 03:23:45 on dist-test-slave-2w3w"
server_key: "7b82f090f0e4125a504e68fdb1a4763f"
server_key_iv: "448eebf2afde92be88e095ad5f41f8da"
server_key_version: "encryptionkey@0"
I20260809 03:23:45.764020 14970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "c1b9e89fd789450384d19508e2a23094"
format_stamp: "Formatted at 2026-08-09 03:23:45 on dist-test-slave-2w3w"
server_key: "7b82f090f0e4125a504e68fdb1a4763f"
server_key_iv: "448eebf2afde92be88e095ad5f41f8da"
server_key_version: "encryptionkey@0"
I20260809 03:23:45.765407 14970 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 03:23:45.766148 14985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:45.766335 14970 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:45.766435 14970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "c1b9e89fd789450384d19508e2a23094"
format_stamp: "Formatted at 2026-08-09 03:23:45 on dist-test-slave-2w3w"
server_key: "7b82f090f0e4125a504e68fdb1a4763f"
server_key_iv: "448eebf2afde92be88e095ad5f41f8da"
server_key_version: "encryptionkey@0"
I20260809 03:23:45.766515 14970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:45.783870 14970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:45.786167 14970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:45.786326 14970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:45.786553 14970 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:45.786878 14970 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:45.786931 14970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:45.786989 14970 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:45.787031 14970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:45.793037 14970 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:40113
I20260809 03:23:45.793079 15107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:40113 every 8 connection(s)
I20260809 03:23:45.793401 14970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
Aug 09 03:23:45 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245825, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM
I20260809 03:23:45.802037 14824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:45.794046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:56045 (local address 127.8.5.254:33131)
0809 03:23:45.794111 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:45.794113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:45.794377 (+ 264us) server_negotiation.cc:407] Connection header received
0809 03:23:45.794832 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:45.794834 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:45.794858 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:45.794913 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:45.795884 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:45.796369 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:45.797300 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:45.797482 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:45.797532 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:45.799485 (+ 1953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:45.799486 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:45.799486 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:45.799492 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:45.800813 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:45.801146 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:45.801147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:45.801147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:45.801195 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:45.801492 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:45.801492 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:45.801492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:45.801585 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:45.801632 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:45.801913 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 03:23:45.801972 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 03:23:45.802265 15110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:45.794045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.194:56045)
0809 03:23:45.794246 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:45.794286 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:45.794749 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:45.795037 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:45.795041 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:45.795614 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:45.795800 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:45.795804 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:45.796452 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:45.796452 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:45.797223 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:45.797225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:45.797551 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:45.797552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:45.797660 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:45.798074 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:45.798081 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:45.799407 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:45.800881 (+ 1474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:45.800886 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:45.800888 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:45.801083 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:45.801305 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:45.801305 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:45.801306 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:45.801428 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:45.801642 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:45.801647 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:45.801800 (+ 153us) client_negotiation.cc:769] Sending connection context
0809 03:23:45.801888 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 03:23:45.802005 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":86,"threads_started":1}
I20260809 03:23:45.802362 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 14970
I20260809 03:23:45.802448 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:23:45.802701 8215 external_mini_cluster.cc:1428] Setting key 51a8dabadace38707a6442d79b8e5c15
I20260809 03:23:45.802908 15108 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33131
I20260809 03:23:45.803043 15108 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:45.803216 15108 heartbeater.cc:511] Master 127.8.5.254:33131 requested a full tablet report, sending...
I20260809 03:23:45.803570 14761 ts_manager.cc:194] Registered new tserver with Master: c1b9e89fd789450384d19508e2a23094 (127.8.5.194:40113)
I20260809 03:23:45.803982 14761 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:56045
WARNING: no policy specified for oryx/127.8.5.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.195.keytab.
Entry for principal oryx/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.195.keytab.
I20260809 03:23:45.827950 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33131
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.195.keytab
--principal=oryx/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:42821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:45.908202 15113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:45.908495 15113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:45.908568 15113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:45.909701 15113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:45.909739 15113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:45.909761 15113 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:23:45.911199 15113 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:42821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.195.keytab
--principal=oryx/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15113
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:45.911440 15113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:45.911669 15113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:45.916787 15118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:45.916790 15119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:45.916793 15121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:45.917083 15113 server_base.cc:1034] running on GCE node
I20260809 03:23:45.917348 15113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:45.917596 15113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:45.918744 15113 hybrid_clock.cc:648] HybridClock initialized: now 1786245825918731 us; error 28 us; skew 500 ppm
Aug 09 03:23:45 dist-test-slave-2w3w krb5kdc[14716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245825, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:45.921563 15113 init.cc:377] Logged in from keytab as oryx/127.8.5.195@KRBTEST.COM (short username oryx)
I20260809 03:23:45.921993 15113 webserver.cc:460] Webserver started at http://127.8.5.195:36763/ using document root <none> and password file <none>
I20260809 03:23:45.922250 15113 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:45.922326 15113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:45.922472 15113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:45.923604 15113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "fd526f4d67ce431499d420aaec9e6708"
format_stamp: "Formatted at 2026-08-09 03:23:45 on dist-test-slave-2w3w"
server_key: "4085acbe436ec3c00ccc1f996659df95"
server_key_iv: "5f8512cd313a201f2cad41536b419919"
server_key_version: "encryptionkey@0"
I20260809 03:23:45.924003 15113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "fd526f4d67ce431499d420aaec9e6708"
format_stamp: "Formatted at 2026-08-09 03:23:45 on dist-test-slave-2w3w"
server_key: "4085acbe436ec3c00ccc1f996659df95"
server_key_iv: "5f8512cd313a201f2cad41536b419919"
server_key_version: "encryptionkey@0"
I20260809 03:23:45.925364 15113 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:23:45.926175 15128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:45.926345 15113 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:45.926455 15113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "fd526f4d67ce431499d420aaec9e6708"
format_stamp: "Formatted at 2026-08-09 03:23:45 on dist-test-slave-2w3w"
server_key: "4085acbe436ec3c00ccc1f996659df95"
server_key_iv: "5f8512cd313a201f2cad41536b419919"
server_key_version: "encryptionkey@0"
I20260809 03:23:45.926510 15113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:45.935777 15113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:45.937513 15113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:45.937647 15113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:45.937825 15113 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:45.938112 15113 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:45.938143 15113 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:45.938163 15113 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:45.938175 15113 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:45.943765 15113 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:44749
I20260809 03:23:45.943794 15250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:44749 every 8 connection(s)
I20260809 03:23:45.944123 15113 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
Aug 09 03:23:45 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245825, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM
I20260809 03:23:45.952745 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 15113
I20260809 03:23:45.952857 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:23:45.953051 8215 external_mini_cluster.cc:1428] Setting key 6aaf86946944e9ea26e635b34c73f5bf
I20260809 03:23:45.953512 15253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:45.944771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.195:56065)
0809 03:23:45.944948 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:45.944986 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:45.945420 (+ 434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:45.945681 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:45.945684 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:45.946232 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:45.946420 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:45.946425 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:45.947201 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:45.947202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:45.948055 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:45.948058 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:45.948423 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:45.948424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:45.948523 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:45.948944 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:45.948952 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:45.950304 (+ 1352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:45.951975 (+ 1671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:45.951982 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:45.951985 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:45.952202 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:45.952439 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:45.952440 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:45.952441 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:45.952543 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:45.952811 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:45.952817 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:45.953002 (+ 185us) client_negotiation.cc:769] Sending connection context
0809 03:23:45.953114 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 03:23:45.953280 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":109,"threads_started":1}
I20260809 03:23:45.953524 14824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:45.944803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:56065 (local address 127.8.5.254:33131)
0809 03:23:45.944853 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:45.944855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:45.945068 (+ 213us) server_negotiation.cc:407] Connection header received
0809 03:23:45.945541 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:45.945543 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:45.945553 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:45.945613 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:45.946499 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:45.947126 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:45.948151 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:45.948344 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:45.948405 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:45.950423 (+ 2018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:45.950425 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:45.950425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:45.950433 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:45.951890 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:45.952295 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:45.952297 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:45.952297 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:45.952365 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:45.952618 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:45.952618 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:45.952619 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:45.952736 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:45.952806 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:45.953152 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 03:23:45.953439 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 03:23:45.954068 15251 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33131
I20260809 03:23:45.954161 15251 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:45.954296 15251 heartbeater.cc:511] Master 127.8.5.254:33131 requested a full tablet report, sending...
I20260809 03:23:45.954635 14760 ts_manager.cc:194] Registered new tserver with Master: fd526f4d67ce431499d420aaec9e6708 (127.8.5.195:44749)
I20260809 03:23:45.955055 14760 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:56065
I20260809 03:23:45.964836 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.8.5.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.5.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.5.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.253.keytab.
Entry for principal oryx/127.8.5.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.253.keytab.
I20260809 03:23:45.991472 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.253:38551
--webserver_interface=127.8.5.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.253.keytab
--principal=oryx/127.8.5.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:42821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:33131,127.8.5.253:38551
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:46.072036 15256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:46.072225 15256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:46.072247 15256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:46.073426 15256 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:46.073468 15256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:46.073483 15256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:46.073518 15256 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:46.073546 15256 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:23:46.074998 15256 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:42821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:33131,127.8.5.253:38551
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.253.keytab
--principal=oryx/127.8.5.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.253:38551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.5.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
W20260809 03:23:46.075114 15256 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.8.5.254:33131,127.8.5.253:38551'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 03:23:46.075264 15256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:46.075500 15256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:46.080324 15262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:46.080315 15261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:46.080482 15256 server_base.cc:1034] running on GCE node
W20260809 03:23:46.080423 15264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:46.080807 15256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:46.081092 15256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:46.082257 15256 hybrid_clock.cc:648] HybridClock initialized: now 1786245826082242 us; error 44 us; skew 500 ppm
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:46.084708 15256 init.cc:377] Logged in from keytab as oryx/127.8.5.253@KRBTEST.COM (short username oryx)
I20260809 03:23:46.085139 15256 webserver.cc:460] Webserver started at http://127.8.5.253:36507/ using document root <none> and password file <none>
I20260809 03:23:46.085378 15256 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:46.085423 15256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:46.085601 15256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:46.086611 15256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/data/instance:
uuid: "c6fc776a10204ce79d77d9a2513cf23e"
format_stamp: "Formatted at 2026-08-09 03:23:46 on dist-test-slave-2w3w"
server_key: "808799300d1c1489b09ce36efeb8efd3"
server_key_iv: "c5e5ab4d37a49d08917284965781945f"
server_key_version: "encryptionkey@0"
I20260809 03:23:46.087010 15256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/wal/instance:
uuid: "c6fc776a10204ce79d77d9a2513cf23e"
format_stamp: "Formatted at 2026-08-09 03:23:46 on dist-test-slave-2w3w"
server_key: "808799300d1c1489b09ce36efeb8efd3"
server_key_iv: "c5e5ab4d37a49d08917284965781945f"
server_key_version: "encryptionkey@0"
I20260809 03:23:46.088395 15256 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:23:46.089118 15271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.089289 15256 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:23:46.089387 15256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/wal
uuid: "c6fc776a10204ce79d77d9a2513cf23e"
format_stamp: "Formatted at 2026-08-09 03:23:46 on dist-test-slave-2w3w"
server_key: "808799300d1c1489b09ce36efeb8efd3"
server_key_iv: "c5e5ab4d37a49d08917284965781945f"
server_key_version: "encryptionkey@0"
I20260809 03:23:46.089468 15256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:46.111179 15256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:46.113083 15256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:46.113250 15256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:46.117401 15256 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.253:38551
I20260809 03:23:46.117439 15327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.253:38551 every 8 connection(s)
I20260809 03:23:46.117825 15256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/data/info.pb
I20260809 03:23:46.118868 15328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:46.120533 15328 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.253@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM
I20260809 03:23:46.126180 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 15256
I20260809 03:23:46.129659 14824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.121213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53226 (local address 127.8.5.254:33131)
0809 03:23:46.121279 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.121281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.121478 (+ 197us) server_negotiation.cc:407] Connection header received
0809 03:23:46.121946 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.121947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.121957 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.122014 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.122598 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.123137 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.124128 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.124307 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.124363 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.126598 (+ 2235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.126600 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.126600 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.126607 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.128170 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.128593 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.128594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.128595 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.128658 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.128931 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.128932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.128932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.129084 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.129165 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.129488 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.129570 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 03:23:46.129837 15330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.121176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.0.0.1:53226)
0809 03:23:46.121357 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.121397 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.121864 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.122083 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.122087 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.122338 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.122525 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.122529 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.123249 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.123250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.124051 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.124053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.124378 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.124379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.124473 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.124905 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.124913 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.126499 (+ 1586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.128279 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.128286 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.128288 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.128513 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.128739 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.128740 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.128740 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.128854 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.129156 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.129162 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.129346 (+ 184us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.129454 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.129603 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":106,"threads_started":1}
I20260809 03:23:46.130586 15328 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.5.253@KRBTEST.COM
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.253@KRBTEST.COM for oryx/127.8.5.253@KRBTEST.COM
I20260809 03:23:46.135525 15332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.126738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44672 (local address 127.8.5.253:38551)
0809 03:23:46.126946 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.126951 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.127007 (+ 56us) server_negotiation.cc:407] Connection header received
0809 03:23:46.127029 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.127031 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.127050 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.127132 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.127712 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.128372 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.129239 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.129535 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.129626 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.132348 (+ 2722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.132355 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.132356 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.132362 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.133921 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.134288 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.134293 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.134293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.134348 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.134566 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.134567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.134568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.134707 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.134895 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.134946 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.135081 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":79,"threads_started":1}
I20260809 03:23:46.137837 15330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.130840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38551 (local address 127.0.0.1:44680)
0809 03:23:46.130888 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.130899 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.130935 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.131189 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.131189 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.131335 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.131387 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.131389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.132083 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.132084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.132532 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.132534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.133064 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.133065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.133153 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.133538 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.133543 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.134710 (+ 1167us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.137095 (+ 2385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.137096 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.137096 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.137276 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.137427 (+ 151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.137428 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.137428 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.137477 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.137634 (+ 157us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.137634 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.137663 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.137709 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.137779 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 03:23:46.137953 15333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.130905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44680 (local address 127.8.5.253:38551)
0809 03:23:46.131079 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.131081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.131086 (+ 5us) server_negotiation.cc:407] Connection header received
0809 03:23:46.131100 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.131100 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.131107 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.131187 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.131470 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.132001 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.132634 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.132978 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.133047 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.134849 (+ 1802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.134851 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.134851 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.134858 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.137023 (+ 2165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.137323 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.137324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.137324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.137373 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.137513 (+ 140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.137513 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.137514 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.137589 (+ 75us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.137632 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.137723 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.137825 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":150,"thread_start_us":122,"threads_started":1}
I20260809 03:23:46.139160 15328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: Bootstrap starting.
I20260809 03:23:46.139747 15328 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:46.140033 15328 log.cc:824] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:46.140722 15328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: No bootstrap required, opened a new log
I20260809 03:23:46.142050 15328 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } }
I20260809 03:23:46.142187 15328 raft_consensus.cc:374] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:46.142234 15328 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6fc776a10204ce79d77d9a2513cf23e, State: Initialized, Role: FOLLOWER
I20260809 03:23:46.142393 15328 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } }
I20260809 03:23:46.142644 15335 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } } }
I20260809 03:23:46.142690 15328 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:46.142745 15335 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [sys.catalog]: This master's current role is: FOLLOWER
W20260809 03:23:46.144351 15347 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:23:46.144418 15347 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:23:46.146015 15256 master_runner.cc:428] Detected that this master c6fc776a10204ce79d77d9a2513cf23e is joining an existing cluster
I20260809 03:23:46.146078 15256 master_runner.cc:432] Initiating AddMaster RPC to add 127.8.5.253:38551
I20260809 03:23:46.154170 14824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.147104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53238 (local address 127.8.5.254:33131)
0809 03:23:46.147167 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.147170 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.147317 (+ 147us) server_negotiation.cc:407] Connection header received
0809 03:23:46.147368 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.147369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.147380 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.147440 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.147779 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.148494 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.149283 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.149550 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.149619 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.150811 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.150812 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.150812 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.150818 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.152776 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.153273 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.153274 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.153274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.153342 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.153607 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.153608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.153608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.153747 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.153807 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.154007 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.154077 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 03:23:46.154199 15353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.147044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.0.0.1:53238)
0809 03:23:46.147224 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.147235 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.147310 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.147443 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.147444 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.147619 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.147697 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.147699 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.148577 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.148578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.149187 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.149189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.149618 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.149619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.149688 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.150112 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.150117 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.150540 (+ 423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.152868 (+ 2328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.152869 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.152869 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.153180 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.153424 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.153425 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.153426 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.153493 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.153831 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.153832 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.153884 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.153964 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.154064 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":98,"threads_started":1}
I20260809 03:23:46.155099 15354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.147367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38551 (local address 127.0.0.1:44694)
0809 03:23:46.147784 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.147791 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.147858 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.147960 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.147961 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.148106 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.148146 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.148147 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.148848 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.148849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.149659 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.149662 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.150432 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.150433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.150500 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.150822 (+ 322us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.150826 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.151237 (+ 411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.153800 (+ 2563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.153801 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.153802 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.154016 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.154402 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.154403 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.154403 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.154477 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.154730 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.154731 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.154799 (+ 68us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.154870 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.154988 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":67,"threads_started":1}
I20260809 03:23:46.155170 15333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.147514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44694 (local address 127.8.5.253:38551)
0809 03:23:46.147550 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.147552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.147844 (+ 292us) server_negotiation.cc:407] Connection header received
0809 03:23:46.147909 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.147910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.147917 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.147959 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.148224 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.148757 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.149739 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.150322 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.150407 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.151332 (+ 925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.151333 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.151334 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.151340 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.153725 (+ 2385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.154101 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.154102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.154102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.154151 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.154548 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.154549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.154549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.154656 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.154693 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.154898 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.155055 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":74,"server-negotiator.queue_time_us":20}
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245825, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.254@KRBTEST.COM for oryx/127.8.5.253@KRBTEST.COM
I20260809 03:23:46.163187 15333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.156637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44700 (local address 127.8.5.253:38551)
0809 03:23:46.156677 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.156679 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.156839 (+ 160us) server_negotiation.cc:407] Connection header received
0809 03:23:46.156930 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.156930 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.156939 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.157010 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.157424 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.157835 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.158565 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.158767 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.158839 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.160699 (+ 1860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.160700 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.160700 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.160707 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.161957 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.162357 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.162358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.162358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.162416 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.162630 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.162630 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.162631 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.162736 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.162811 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.163020 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.163095 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 03:23:46.163221 15355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.156589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38551 (local address 127.0.0.1:44700)
0809 03:23:46.156731 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.156774 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.156867 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.157016 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.157019 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.157281 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.157337 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.157338 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.157919 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.157919 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.158481 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.158483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.158840 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.158849 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.158930 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.159393 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.159397 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.160605 (+ 1208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.162039 (+ 1434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.162047 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.162049 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.162253 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.162488 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.162489 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.162489 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.162551 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.162806 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.162815 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.162876 (+ 61us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.162968 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.163107 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":68,"threads_started":1}
I20260809 03:23:46.163764 14760 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.8.5.253:38551: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e"
member_type: NON_VOTER
last_known_addr {
host: "127.8.5.253"
port: 38551
}
attrs {
promote: true
}
}
dest_uuid: "775fc7fbd9ce4ed98bcff9377b58c161"
cas_config_opid_index: -1
I20260809 03:23:46.164160 14760 consensus_queue.cc:237] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: NON_VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: true } }
I20260809 03:23:46.164631 15356 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER c6fc776a10204ce79d77d9a2513cf23e (127.8.5.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: NON_VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: true } } }
I20260809 03:23:46.164948 15299 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:46.165781 15356 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.8.5.253:38551
I20260809 03:23:46.165880 15299 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 1 FOLLOWER]: Refusing update from remote peer 775fc7fbd9ce4ed98bcff9377b58c161: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 03:23:46.165874 15357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: NON_VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: true } } }
I20260809 03:23:46.165968 15357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:46.166298 15256 master.cc:537] Master@127.8.5.253:38551 shutting down...
I20260809 03:23:46.166299 15357 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: NON_VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 03:23:46.167825 14747 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260809 03:23:46.168692 14747 consensus_peers.cc:487] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 -> Peer c6fc776a10204ce79d77d9a2513cf23e (127.8.5.253:38551): Couldn't send request to peer c6fc776a10204ce79d77d9a2513cf23e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 03:23:46.169121 15256 raft_consensus.cc:2229] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:46.169211 15256 raft_consensus.cc:2258] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:46.169260 15256 tablet_replica.cc:330] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: stopping tablet replica
I20260809 03:23:46.184542 15256 master.cc:552] Master@127.8.5.253:38551 shutdown complete.
I20260809 03:23:46.184598 15256 master_runner.cc:305] Clearing existing system tablet
I20260809 03:23:46.184729 15256 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:46.184787 15256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:46.185496 15256 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.001s
I20260809 03:23:46.186131 15361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.186355 15256 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:46.186419 15256 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 03:23:46.186444 15256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/wal
uuid: "c6fc776a10204ce79d77d9a2513cf23e"
format_stamp: "Formatted at 2026-08-09 03:23:46 on dist-test-slave-2w3w"
server_key: "808799300d1c1489b09ce36efeb8efd3"
server_key_iv: "c5e5ab4d37a49d08917284965781945f"
server_key_version: "encryptionkey@0"
I20260809 03:23:46.187508 15256 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:46.189123 15256 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 03:23:46.189196 15256 log.cc:1196] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 03:23:46.189396 15256 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: Deleting consensus metadata
I20260809 03:23:46.189591 15256 master_runner.cc:315] Copying system tablet from 127.8.5.254:33131
I20260809 03:23:46.190208 15256 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.5.254:33131
I20260809 03:23:46.196928 15367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.190539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.0.0.1:53242)
0809 03:23:46.190653 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.190665 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.190727 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.190875 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.190876 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.191093 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.191152 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.191155 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.192148 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.192149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.192720 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.192723 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.193223 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.193224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.193276 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.193777 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.193782 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.194115 (+ 333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.195954 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.195955 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.195956 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.196123 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.196332 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.196332 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.196332 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.196386 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.196650 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.196650 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.196688 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.196750 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.196828 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":77,"threads_started":1}
I20260809 03:23:46.196978 14824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.190627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53242 (local address 127.8.5.254:33131)
0809 03:23:46.190683 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.190685 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.190718 (+ 33us) server_negotiation.cc:407] Connection header received
0809 03:23:46.190783 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.190784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.190796 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.190872 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.191250 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.192060 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.192839 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.193144 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.193220 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.194206 (+ 986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.194208 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.194208 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.194216 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.195862 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.196192 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.196193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.196193 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.196260 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.196449 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.196450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.196450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.196587 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.196656 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.196801 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.196883 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 03:23:46.197659 14782 tablet_copy_service.cc:140] P 775fc7fbd9ce4ed98bcff9377b58c161: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer c6fc776a10204ce79d77d9a2513cf23e ({username='oryx', principal='oryx/127.8.5.253@KRBTEST.COM'} at 127.0.0.1:53242)
I20260809 03:23:46.197799 14782 tablet_copy_service.cc:161] P 775fc7fbd9ce4ed98bcff9377b58c161: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer c6fc776a10204ce79d77d9a2513cf23e at {username='oryx', principal='oryx/127.8.5.253@KRBTEST.COM'} at 127.0.0.1:53242: session id = c6fc776a10204ce79d77d9a2513cf23e-00000000000000000000000000000000
I20260809 03:23:46.198501 14782 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 03:23:46.199177 15256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 03:23:46.200155 15256 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: tablet copy: Starting download of 0 data blocks...
I20260809 03:23:46.200320 15256 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: tablet copy: Starting download of 1 WAL segments...
I20260809 03:23:46.201299 15256 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 03:23:46.202069 14782 tablet_copy_service.cc:342] P 775fc7fbd9ce4ed98bcff9377b58c161: Request end of tablet copy session c6fc776a10204ce79d77d9a2513cf23e-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.8.5.253@KRBTEST.COM'} at 127.0.0.1:53242
I20260809 03:23:46.202122 14782 tablet_copy_service.cc:433] P 775fc7fbd9ce4ed98bcff9377b58c161: ending tablet copy session c6fc776a10204ce79d77d9a2513cf23e-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer c6fc776a10204ce79d77d9a2513cf23e
I20260809 03:23:46.204808 15256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:46.205958 15368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:46.206048 15369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:46.206158 15256 server_base.cc:1034] running on GCE node
W20260809 03:23:46.206218 15372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:46.206480 15256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:46.206651 15256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:46.207774 15256 hybrid_clock.cc:648] HybridClock initialized: now 1786245826207768 us; error 25 us; skew 500 ppm
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:46.209074 15256 init.cc:377] Logged in from keytab as oryx/127.8.5.253@KRBTEST.COM (short username oryx)
I20260809 03:23:46.209373 15256 webserver.cc:460] Webserver started at http://127.8.5.253:34281/ using document root <none> and password file <none>
I20260809 03:23:46.209507 15256 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:46.209548 15256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:46.210142 15256 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:46.210660 15380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.210783 15256 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.210826 15256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/wal
uuid: "c6fc776a10204ce79d77d9a2513cf23e"
format_stamp: "Formatted at 2026-08-09 03:23:46 on dist-test-slave-2w3w"
server_key: "808799300d1c1489b09ce36efeb8efd3"
server_key_iv: "c5e5ab4d37a49d08917284965781945f"
server_key_version: "encryptionkey@0"
I20260809 03:23:46.210884 15256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:46.217196 15256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:46.218724 15256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:46.221869 15256 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.253:38551
I20260809 03:23:46.222182 15435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.253:38551 every 8 connection(s)
I20260809 03:23:46.222280 15256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-1/data/info.pb
I20260809 03:23:46.223232 15436 sys_catalog.cc:263] Verifying existing consensus state
I20260809 03:23:46.223779 15436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: Bootstrap starting.
I20260809 03:23:46.227133 15436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 03:23:46.227387 15436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: Bootstrap complete.
I20260809 03:23:46.227589 15436 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: NON_VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: true } }
I20260809 03:23:46.227681 15436 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c6fc776a10204ce79d77d9a2513cf23e, State: Initialized, Role: LEARNER
I20260809 03:23:46.227721 15436 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: NON_VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: true } }
I20260809 03:23:46.227907 15436 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:46.227921 15439 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: NON_VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: true } } }
I20260809 03:23:46.228082 15439 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [sys.catalog]: This master's current role is: LEARNER
I20260809 03:23:46.229526 15453 catalog_manager.cc:1259] Loaded cluster ID: 384b17053f054eb2bbf5395ea2d70ae2
I20260809 03:23:46.229612 15453 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: loading cluster ID for follower catalog manager: success
I20260809 03:23:46.230938 15453 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: acquiring CA information for follower catalog manager: success
I20260809 03:23:46.231256 15453 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 03:23:46.244040 15454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.237051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44726 (local address 127.8.5.253:38551)
0809 03:23:46.237184 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.237186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.237198 (+ 12us) server_negotiation.cc:407] Connection header received
0809 03:23:46.237224 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.237225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.237237 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.237324 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.237854 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.238854 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.239621 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.239943 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.240018 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.241219 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.241221 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.241221 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.241229 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.242863 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.243255 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.243256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.243257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.243325 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.243518 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.243520 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.243520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.243656 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.243779 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.243845 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.243928 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":63,"threads_started":1}
WARNING: no policy specified for oryx/127.8.5.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.5.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.5.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.252.keytab.
Entry for principal oryx/127.8.5.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.252.keytab.
I20260809 03:23:46.269945 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.252:45619
--webserver_interface=127.8.5.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.252.keytab
--principal=oryx/127.8.5.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:42821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:33131,127.8.5.253:38551,127.8.5.252:45619
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:46.352624 15457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:46.352821 15457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:46.352844 15457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:46.353964 15457 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:46.354007 15457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:46.354020 15457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:46.354033 15457 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:46.354077 15457 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:23:46.355633 15457 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:42821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:33131,127.8.5.253:38551,127.8.5.252:45619
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.252.keytab
--principal=oryx/127.8.5.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.252:45619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.5.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:46.355887 15457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:46.356120 15457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:46.360792 15462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:46.360833 15463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:46.360824 15465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:46.361002 15457 server_base.cc:1034] running on GCE node
I20260809 03:23:46.361281 15457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:46.361563 15457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:46.362707 15457 hybrid_clock.cc:648] HybridClock initialized: now 1786245826362685 us; error 35 us; skew 500 ppm
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:46.365311 15457 init.cc:377] Logged in from keytab as oryx/127.8.5.252@KRBTEST.COM (short username oryx)
I20260809 03:23:46.365754 15457 webserver.cc:460] Webserver started at http://127.8.5.252:41807/ using document root <none> and password file <none>
I20260809 03:23:46.365978 15457 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:46.366046 15457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:46.366195 15457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:46.367311 15457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/data/instance:
uuid: "3aee4f6c7dbb4cbab49477116ed3acb5"
format_stamp: "Formatted at 2026-08-09 03:23:46 on dist-test-slave-2w3w"
server_key: "50b1aa9d60fde17a8b803bffee4824a8"
server_key_iv: "aa750b5d5a81d0bd4afa191a1cd98092"
server_key_version: "encryptionkey@0"
I20260809 03:23:46.367674 15457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/wal/instance:
uuid: "3aee4f6c7dbb4cbab49477116ed3acb5"
format_stamp: "Formatted at 2026-08-09 03:23:46 on dist-test-slave-2w3w"
server_key: "50b1aa9d60fde17a8b803bffee4824a8"
server_key_iv: "aa750b5d5a81d0bd4afa191a1cd98092"
server_key_version: "encryptionkey@0"
I20260809 03:23:46.369045 15457 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:46.369875 15472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.370115 15457 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:46.370220 15457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/wal
uuid: "3aee4f6c7dbb4cbab49477116ed3acb5"
format_stamp: "Formatted at 2026-08-09 03:23:46 on dist-test-slave-2w3w"
server_key: "50b1aa9d60fde17a8b803bffee4824a8"
server_key_iv: "aa750b5d5a81d0bd4afa191a1cd98092"
server_key_version: "encryptionkey@0"
I20260809 03:23:46.370309 15457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:46.382082 15457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:46.383971 15457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:46.384123 15457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:46.388180 15457 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.252:45619
I20260809 03:23:46.388236 15526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.252:45619 every 8 connection(s)
I20260809 03:23:46.388582 15457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/data/info.pb
I20260809 03:23:46.389482 15527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:46.391175 15527 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:23:46.395109 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 15457
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.252@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.5.252@KRBTEST.COM
I20260809 03:23:46.401973 14824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.392020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53258 (local address 127.8.5.254:33131)
0809 03:23:46.392065 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.392067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.392232 (+ 165us) server_negotiation.cc:407] Connection header received
0809 03:23:46.392795 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.392797 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.392809 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.392876 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.393541 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.394049 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.395505 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.395895 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.395982 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.398812 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.398814 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.398814 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.398820 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.400431 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.400954 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.400954 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.400955 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.401006 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.401310 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.401311 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.401311 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.401466 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.401542 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.401786 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.401869 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:23:46.402191 15531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.391857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.0.0.1:53258)
0809 03:23:46.392074 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.392123 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.392663 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.392973 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.392977 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.393221 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.393407 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.393411 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.394139 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.394140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.395174 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.395177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.395998 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.395998 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.396148 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.396812 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.396823 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.398712 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.400519 (+ 1807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.400527 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.400530 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.400876 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.401075 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.401076 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.401076 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.401229 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.401536 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.401540 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.401653 (+ 113us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.401737 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.401930 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":97,"threads_started":1}
I20260809 03:23:46.402827 15527 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:23:46.405454 15532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.395757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58524 (local address 127.8.5.252:45619)
0809 03:23:46.395927 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.395931 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.395946 (+ 15us) server_negotiation.cc:407] Connection header received
0809 03:23:46.395986 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.395988 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.396007 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.396085 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.396831 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.397793 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.398907 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.399377 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.399455 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.402399 (+ 2944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.402404 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.402405 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.402411 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.404218 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.404590 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.404593 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.404594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.404658 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.404878 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.404879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.404879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.405021 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.405169 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.405242 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.405318 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":104,"threads_started":1}
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.252@KRBTEST.COM for oryx/127.8.5.253@KRBTEST.COM
I20260809 03:23:46.409286 15531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.403090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38551 (local address 127.0.0.1:44734)
0809 03:23:46.403140 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.403150 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.403185 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.403402 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.403403 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.403539 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.403582 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.403584 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.404249 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.404250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.404743 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.404745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.405160 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.405161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.405235 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.405612 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.405617 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.406836 (+ 1219us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.408527 (+ 1691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.408528 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.408528 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.408679 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.408864 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.408864 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.408864 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.408911 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.409085 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.409086 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.409117 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.409165 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.409231 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 03:23:46.409322 15454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.403193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44734 (local address 127.8.5.253:38551)
0809 03:23:46.403264 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.403266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.403274 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:23:46.403322 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.403323 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.403334 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.403400 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.403669 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.404149 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.404852 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.405073 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.405159 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.406930 (+ 1771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.406932 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.406932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.406939 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.408455 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.408755 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.408755 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.408756 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.408807 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.408949 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.408949 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.408950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.409039 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.409085 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.409182 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.409245 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 03:23:46.409840 15527 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.252@KRBTEST.COM for oryx/127.8.5.252@KRBTEST.COM
I20260809 03:23:46.416193 15531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.410127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:45619 (local address 127.0.0.1:58540)
0809 03:23:46.410171 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.410179 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.410216 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.410320 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.410321 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.410429 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.410457 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.410458 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.411320 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.411321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.411801 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.411802 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.412214 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.412215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.412260 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.412607 (+ 347us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.412610 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.413705 (+ 1095us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.415366 (+ 1661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.415367 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.415367 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.415523 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.415692 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.415692 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.415692 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.415741 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.415974 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.415975 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.416006 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.416055 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.416134 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15}
I20260809 03:23:46.416254 15532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.410170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58540 (local address 127.8.5.252:45619)
0809 03:23:46.410206 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.410207 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.410215 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:23:46.410267 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.410268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.410276 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.410312 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.410565 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.411225 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.411870 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.412120 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.412187 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.413791 (+ 1604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.413792 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.413792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.413798 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.415295 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.415587 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.415588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.415588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.415636 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.415822 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.415823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.415823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.415922 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.415977 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.416079 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.416181 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":19}
I20260809 03:23:46.417547 15527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: Bootstrap starting.
I20260809 03:23:46.418532 15527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:46.418828 15527 log.cc:824] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:46.419667 15527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: No bootstrap required, opened a new log
I20260809 03:23:46.421217 15527 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } }
I20260809 03:23:46.421401 15527 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:46.421458 15527 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3aee4f6c7dbb4cbab49477116ed3acb5, State: Initialized, Role: FOLLOWER
I20260809 03:23:46.421597 15527 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } }
I20260809 03:23:46.421927 15527 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:46.421917 15534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } } }
I20260809 03:23:46.422027 15534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 03:23:46.423801 15546 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:23:46.423859 15546 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:23:46.426412 15457 master_runner.cc:428] Detected that this master 3aee4f6c7dbb4cbab49477116ed3acb5 is joining an existing cluster
I20260809 03:23:46.426457 15457 master_runner.cc:432] Initiating AddMaster RPC to add 127.8.5.252:45619
I20260809 03:23:46.434119 14824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.427579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53268 (local address 127.8.5.254:33131)
0809 03:23:46.427635 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.427637 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.427755 (+ 118us) server_negotiation.cc:407] Connection header received
0809 03:23:46.427868 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.427869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.427879 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.427929 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.428299 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.428992 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.429976 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.430251 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.430335 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.431484 (+ 1149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.431485 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.431485 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.431492 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.432980 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.433378 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.433379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.433379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.433442 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.433638 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.433639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.433639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.433744 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.433791 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.433994 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.434053 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 03:23:46.434211 15552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.427540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.0.0.1:53268)
0809 03:23:46.427693 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.427703 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.427777 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.427932 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.427933 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.428146 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.428216 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.428218 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.429096 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.429098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.429882 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.429885 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.430348 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.430348 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.430426 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.430913 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.430919 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.431385 (+ 466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.433064 (+ 1679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.433065 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.433065 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.433303 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.433506 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.433506 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.433507 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.433580 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.433805 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.433806 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.433862 (+ 56us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.433979 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.434087 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":89,"threads_started":1}
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245825, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.254@KRBTEST.COM for oryx/127.8.5.252@KRBTEST.COM
I20260809 03:23:46.457036 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 14828
I20260809 03:23:46.467211 15554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.427764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:45619 (local address 127.0.0.1:58546)
0809 03:23:46.435034 (+ 7270us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.435048 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.435114 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.435437 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.435438 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.435630 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.435703 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.435705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.436595 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.436596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.437326 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.437328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.437769 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.437769 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.437840 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.463564 (+ 25724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.463570 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.464061 (+ 491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.466018 (+ 1957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.466020 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.466020 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.466251 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.466458 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.466459 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.466459 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.466512 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.466817 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.466818 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.466857 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.466926 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.467063 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7251,"thread_start_us":93,"threads_started":1}
I20260809 03:23:46.467794 15532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.428037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58546 (local address 127.8.5.252:45619)
0809 03:23:46.428075 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.428077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.435114 (+ 7037us) server_negotiation.cc:407] Connection header received
0809 03:23:46.435205 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.435206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.435216 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.435265 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.435781 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.436510 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.437429 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.437698 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.437770 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.464178 (+ 26408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.464180 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.464180 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.464187 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.465933 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.466335 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.466336 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.466337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.466392 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.466574 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.466574 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.466575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.466721 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.466794 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.467626 (+ 832us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.467710 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:23:46.467805 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:33243
--local_ip_for_outbound_sockets=127.8.5.193
--tserver_master_addrs=127.8.5.254:33131
--webserver_port=45483
--webserver_interface=127.8.5.193
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.193.keytab
--principal=oryx/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:42821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.8.5.254:33131,127.8.5.253:38551
--tserver_master_addrs=127.8.5.254:33131,127.8.5.253:38551,127.8.5.252:45619 with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 03:23:46.469136 15454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.428001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44748 (local address 127.8.5.253:38551)
0809 03:23:46.428043 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.428045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.434340 (+ 6295us) server_negotiation.cc:407] Connection header received
0809 03:23:46.434436 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.434437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.434449 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.434504 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.434856 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.435618 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.436747 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.437069 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.437110 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.465795 (+ 28685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.465798 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.465799 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.465810 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.467605 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.468126 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.468127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.468128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.468198 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.468516 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.468517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.468517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.468666 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.468717 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.468944 (+ 227us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.469034 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 03:23:46.469508 15552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.427601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38551 (local address 127.0.0.1:44748)
0809 03:23:46.434279 (+ 6678us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.434290 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.434370 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.434550 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.434550 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.434719 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.434791 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.434794 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.435707 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.435708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.436643 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.436646 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.437185 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.437186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.437250 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.464363 (+ 27113us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.464368 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.465622 (+ 1254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.467705 (+ 2083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.467706 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.467706 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.467966 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.468336 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.468336 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.468337 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.468418 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.468772 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.468773 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.468820 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.469293 (+ 473us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.469396 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6666,"thread_start_us":67,"threads_started":1}
I20260809 03:23:46.471259 15555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.437051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58562 (local address 127.8.5.252:45619)
0809 03:23:46.437473 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.437474 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.437479 (+ 5us) server_negotiation.cc:407] Connection header received
0809 03:23:46.437510 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.437510 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.437522 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.437579 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.438023 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.438862 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.439571 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.439933 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.440005 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.441745 (+ 1740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.441747 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.441747 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.441754 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.469984 (+ 28230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.470402 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.470403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.470403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.470470 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.470687 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.470688 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.470688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.470811 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.470886 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.471074 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.471156 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":109,"threads_started":1}
I20260809 03:23:46.471267 15355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.436855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:45619 (local address 127.0.0.1:58562)
0809 03:23:46.436945 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.436954 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.436988 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.437605 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.437607 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.437771 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.437832 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.437834 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.438948 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.438949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.439491 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.439493 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.440010 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.440011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.440059 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.440458 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.440462 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.441654 (+ 1192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.470093 (+ 28439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.470095 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.470095 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.470307 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.470542 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.470543 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.470544 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.470609 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.470893 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.470894 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.470946 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.471047 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.471163 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260809 03:23:46.471854 14760 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.8.5.252:45619: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5"
member_type: NON_VOTER
last_known_addr {
host: "127.8.5.252"
port: 45619
}
attrs {
promote: true
}
}
dest_uuid: "775fc7fbd9ce4ed98bcff9377b58c161"
cas_config_opid_index: 5
I20260809 03:23:46.472126 14760 consensus_queue.cc:237] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: NON_VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: true } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: NON_VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: true } }
I20260809 03:23:46.472488 15357 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3aee4f6c7dbb4cbab49477116ed3acb5 (127.8.5.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: NON_VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: true } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: NON_VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: true } } }
I20260809 03:23:46.473483 15357 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.8.5.252:45619
I20260809 03:23:46.473567 15357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: NON_VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: true } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: NON_VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: true } } }
I20260809 03:23:46.473639 15357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:46.473959 15457 master.cc:537] Master@127.8.5.252:45619 shutting down...
W20260809 03:23:46.475351 14747 consensus_peers.cc:487] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 -> Peer 3aee4f6c7dbb4cbab49477116ed3acb5 (127.8.5.252:45619): Couldn't send request to peer 3aee4f6c7dbb4cbab49477116ed3acb5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 03:23:46.477103 15457 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:46.477188 15457 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:46.477228 15457 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: stopping tablet replica
I20260809 03:23:46.480007 15454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.473970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44762 (local address 127.8.5.253:38551)
0809 03:23:46.474020 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.474021 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.475735 (+ 1714us) server_negotiation.cc:407] Connection header received
0809 03:23:46.475762 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.475763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.475781 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.475854 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:46.476575 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.477363 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.478951 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.479587 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.479656 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.479720 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.479915 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.479951 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 03:23:46.480005 15355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.473911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38551 (local address 127.0.0.1:44762)
0809 03:23:46.475615 (+ 1704us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.475626 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.475679 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.476445 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.476446 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.476448 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:46.476492 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.476493 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.477636 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.477637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.478865 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.478869 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.479758 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.479759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.479808 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.479824 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.479895 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.479937 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1686}
I20260809 03:23:46.480527 15408 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 1 LEARNER]: Refusing update from remote peer 775fc7fbd9ce4ed98bcff9377b58c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 03:23:46.480772 15356 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: NON_VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 03:23:46.481428 15408 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3aee4f6c7dbb4cbab49477116ed3acb5 (127.8.5.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: NON_VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: true } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: NON_VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: true } } }
I20260809 03:23:46.482687 15356 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161: attempting to promote NON_VOTER c6fc776a10204ce79d77d9a2513cf23e to VOTER
I20260809 03:23:46.482713 15439 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 775fc7fbd9ce4ed98bcff9377b58c161. Latest consensus state: current_term: 1 leader_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: NON_VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: true } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: NON_VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: true } } }
I20260809 03:23:46.482805 15439 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [sys.catalog]: This master's current role is: LEARNER
I20260809 03:23:46.482841 15439 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: NON_VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: true } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: NON_VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: true } } }
I20260809 03:23:46.482877 15439 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [sys.catalog]: This master's current role is: LEARNER
I20260809 03:23:46.482879 15356 consensus_queue.cc:237] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: NON_VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: true } }
I20260809 03:23:46.483580 15355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.483447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:45619 (local address 127.0.0.1:58568)
0809 03:23:46.483501 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.483547 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:45619: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 03:23:46.483634 15408 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 1 LEARNER]: Refusing update from remote peer 775fc7fbd9ce4ed98bcff9377b58c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 03:23:46.483837 15357 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260809 03:23:46.484153 15355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.484042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:45619 (local address 127.0.0.1:58584)
0809 03:23:46.484101 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.484129 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:45619: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 03:23:46.484359 14747 consensus_peers.cc:487] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 -> Peer 3aee4f6c7dbb4cbab49477116ed3acb5 (127.8.5.252:45619): Couldn't send request to peer 3aee4f6c7dbb4cbab49477116ed3acb5. Status: Network error: Client connection negotiation failed: client connection to 127.8.5.252:45619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 03:23:46.484582 15559 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, c6fc776a10204ce79d77d9a2513cf23e (127.8.5.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: NON_VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: true } } }
I20260809 03:23:46.484740 15408 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, c6fc776a10204ce79d77d9a2513cf23e (127.8.5.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: NON_VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: true } } }
I20260809 03:23:46.485596 15559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: NON_VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: true } } }
I20260809 03:23:46.485621 15439 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: NON_VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: true } } }
I20260809 03:23:46.485689 15439 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:23:46.485867 15356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: NON_VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: true } } }
I20260809 03:23:46.485957 15356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:46.485867 15559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:46.490480 15457 master.cc:552] Master@127.8.5.252:45619 shutdown complete.
I20260809 03:23:46.490554 15457 master_runner.cc:305] Clearing existing system tablet
I20260809 03:23:46.490687 15457 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:46.490747 15457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:46.491484 15457 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.491989 15561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.492111 15457 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:46.492159 15457 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.492187 15457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/wal
uuid: "3aee4f6c7dbb4cbab49477116ed3acb5"
format_stamp: "Formatted at 2026-08-09 03:23:46 on dist-test-slave-2w3w"
server_key: "50b1aa9d60fde17a8b803bffee4824a8"
server_key_iv: "aa750b5d5a81d0bd4afa191a1cd98092"
server_key_version: "encryptionkey@0"
I20260809 03:23:46.492870 15457 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:46.494278 15457 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 03:23:46.494370 15457 log.cc:1196] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 03:23:46.494570 15457 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: Deleting consensus metadata
I20260809 03:23:46.494707 15457 master_runner.cc:315] Copying system tablet from 127.8.5.254:33131
I20260809 03:23:46.495445 15457 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: tablet copy: Beginning tablet copy session from remote peer at address 127.8.5.254:33131
I20260809 03:23:46.503284 15567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.495775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.0.0.1:53278)
0809 03:23:46.495906 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.495915 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.495997 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.496121 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.496122 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.496327 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.496388 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.496390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.497075 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.497076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.497656 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.497658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.498050 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.498050 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.498118 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.498635 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.498640 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.498954 (+ 314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.500640 (+ 1686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.500641 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.500641 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.500825 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.501046 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.501047 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.501047 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.502502 (+ 1455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.502888 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.502889 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.502929 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.503059 (+ 130us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.503174 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":76,"threads_started":1}
I20260809 03:23:46.503270 14824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.495818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53278 (local address 127.8.5.254:33131)
0809 03:23:46.495862 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.495864 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.495982 (+ 118us) server_negotiation.cc:407] Connection header received
0809 03:23:46.496050 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.496051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.496061 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.496108 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.496475 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.496988 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.497757 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.497973 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.498050 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.499086 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.499088 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.499088 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.499096 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.500536 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.500914 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.500916 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.500916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.500972 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.502591 (+ 1619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.502592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.502592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.502729 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.502807 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.503088 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.503174 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:23:46.503904 14782 tablet_copy_service.cc:140] P 775fc7fbd9ce4ed98bcff9377b58c161: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3aee4f6c7dbb4cbab49477116ed3acb5 ({username='oryx', principal='oryx/127.8.5.252@KRBTEST.COM'} at 127.0.0.1:53278)
I20260809 03:23:46.503988 14782 tablet_copy_service.cc:161] P 775fc7fbd9ce4ed98bcff9377b58c161: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3aee4f6c7dbb4cbab49477116ed3acb5 at {username='oryx', principal='oryx/127.8.5.252@KRBTEST.COM'} at 127.0.0.1:53278: session id = 3aee4f6c7dbb4cbab49477116ed3acb5-00000000000000000000000000000000
I20260809 03:23:46.504459 14782 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 03:23:46.504932 15457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 03:23:46.505885 15457 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: tablet copy: Starting download of 0 data blocks...
I20260809 03:23:46.506062 15457 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: tablet copy: Starting download of 1 WAL segments...
I20260809 03:23:46.506745 15457 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 03:23:46.507586 14782 tablet_copy_service.cc:342] P 775fc7fbd9ce4ed98bcff9377b58c161: Request end of tablet copy session 3aee4f6c7dbb4cbab49477116ed3acb5-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.8.5.252@KRBTEST.COM'} at 127.0.0.1:53278
I20260809 03:23:46.507639 14782 tablet_copy_service.cc:433] P 775fc7fbd9ce4ed98bcff9377b58c161: ending tablet copy session 3aee4f6c7dbb4cbab49477116ed3acb5-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3aee4f6c7dbb4cbab49477116ed3acb5
I20260809 03:23:46.509856 15457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:46.511065 15568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:46.511240 15571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:46.511333 15457 server_base.cc:1034] running on GCE node
W20260809 03:23:46.515379 15569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:46.515543 15457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:46.515710 15457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:46.516855 15457 hybrid_clock.cc:648] HybridClock initialized: now 1786245826516846 us; error 27 us; skew 500 ppm
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:46.518245 15457 init.cc:377] Logged in from keytab as oryx/127.8.5.252@KRBTEST.COM (short username oryx)
I20260809 03:23:46.518559 15457 webserver.cc:460] Webserver started at http://127.8.5.252:39813/ using document root <none> and password file <none>
I20260809 03:23:46.518679 15457 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:46.518714 15457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:46.519409 15457 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:46.519971 15578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.520123 15457 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:46.520174 15457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/wal
uuid: "3aee4f6c7dbb4cbab49477116ed3acb5"
format_stamp: "Formatted at 2026-08-09 03:23:46 on dist-test-slave-2w3w"
server_key: "50b1aa9d60fde17a8b803bffee4824a8"
server_key_iv: "aa750b5d5a81d0bd4afa191a1cd98092"
server_key_version: "encryptionkey@0"
I20260809 03:23:46.520236 15457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:46.539420 15457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:46.541198 15457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:46.544410 15457 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.252:45619
I20260809 03:23:46.544613 15632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.252:45619 every 8 connection(s)
I20260809 03:23:46.544786 15457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/master-2/data/info.pb
I20260809 03:23:46.545554 15633 sys_catalog.cc:263] Verifying existing consensus state
I20260809 03:23:46.545964 15633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: Bootstrap starting.
I20260809 03:23:46.548244 15633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 03:23:46.548507 15633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: Bootstrap complete.
I20260809 03:23:46.548731 15633 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: NON_VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: true } }
I20260809 03:23:46.548835 15633 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3aee4f6c7dbb4cbab49477116ed3acb5, State: Initialized, Role: LEARNER
I20260809 03:23:46.548883 15633 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: NON_VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: true } }
I20260809 03:23:46.549072 15633 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:46.549060 15636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: NON_VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: true } } }
I20260809 03:23:46.549273 15636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [sys.catalog]: This master's current role is: LEARNER
I20260809 03:23:46.550724 15647 catalog_manager.cc:1259] Loaded cluster ID: 384b17053f054eb2bbf5395ea2d70ae2
I20260809 03:23:46.551004 15647 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: loading cluster ID for follower catalog manager: success
I20260809 03:23:46.552062 15647 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: acquiring CA information for follower catalog manager: success
I20260809 03:23:46.552350 15647 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 03:23:46.588341 15556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:46.588642 15556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:46.588685 15556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:46.590327 15556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:46.590395 15556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:46.590437 15556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:23:46.592706 15556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:42821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.193.keytab
--principal=oryx/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:33243
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=45483
--tserver_master_addrs=127.8.5.254:33131,127.8.5.253:38551,127.8.5.252:45619
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:46.592962 15556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:46.593220 15556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:46.598518 15654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:46.598531 15656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:46.598537 15653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:46.598795 15556 server_base.cc:1034] running on GCE node
I20260809 03:23:46.599014 15556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:46.599273 15556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:46.600446 15556 hybrid_clock.cc:648] HybridClock initialized: now 1786245826600433 us; error 30 us; skew 500 ppm
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:46.603081 15556 init.cc:377] Logged in from keytab as oryx/127.8.5.193@KRBTEST.COM (short username oryx)
I20260809 03:23:46.603535 15556 webserver.cc:460] Webserver started at http://127.8.5.193:45483/ using document root <none> and password file <none>
I20260809 03:23:46.603765 15556 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:46.603848 15556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:46.605325 15556 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:46.605957 15663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.606104 15556 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.606194 15556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "73eaa15098d547f5ac2372300461ef7e"
format_stamp: "Formatted at 2026-08-09 03:23:45 on dist-test-slave-2w3w"
server_key: "7bb3fa73f29d59b71193f4ab79dc8af2"
server_key_iv: "a5cdb83d3f86b43f59a96bef04257161"
server_key_version: "encryptionkey@0"
I20260809 03:23:46.606537 15556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:46.628654 15556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:46.631284 15556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:46.631413 15556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:46.631615 15556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:46.631949 15556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:46.631983 15556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.632006 15556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:46.632053 15556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.638499 15556 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:33243
I20260809 03:23:46.638587 15782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:33243 every 8 connection(s)
I20260809 03:23:46.638998 15556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:23:46.644695 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 15556
I20260809 03:23:46.644862 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 14970
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.252@KRBTEST.COM
I20260809 03:23:46.650838 14824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.640478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:44517 (local address 127.8.5.254:33131)
0809 03:23:46.640540 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.640542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.640551 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:23:46.640815 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.640816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.640829 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.640870 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.641633 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.642369 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.643571 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.643784 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.643868 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.647334 (+ 3466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.647335 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.647335 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.647343 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.649038 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.649449 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.649450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.649451 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.649516 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.649784 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.649786 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.649786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.649957 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.650029 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.650652 (+ 623us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.650740 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 03:23:46.651165 15788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.639766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:51501 (local address 127.8.5.252:45619)
0809 03:23:46.639969 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.639972 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.640087 (+ 115us) server_negotiation.cc:407] Connection header received
0809 03:23:46.640806 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.640808 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.640823 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.640891 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.641562 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.642568 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.643459 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.643755 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.643822 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.647346 (+ 3524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.647348 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.647348 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.647357 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.649799 (+ 2442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.650209 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.650211 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.650211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.650271 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.650519 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.650520 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.650520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.650707 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.650772 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.651019 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.651101 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":104,"threads_started":1}
I20260809 03:23:46.651417 15791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.640236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.193:44517)
0809 03:23:46.640410 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.640421 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.640719 (+ 298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.640970 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.640970 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.641466 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.641524 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.641525 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.642457 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.642457 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.643508 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.643510 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.643923 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.643924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.644009 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.644713 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.644721 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.647206 (+ 2485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.649117 (+ 1911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.649124 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.649127 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.649353 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.649586 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.649586 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.649587 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.649710 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.650082 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.650091 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.650424 (+ 333us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.650624 (+ 200us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.650856 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":36,"thread_start_us":111,"threads_started":1}
I20260809 03:23:46.651834 15787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.639725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:45619 (local address 127.8.5.193:51501)
0809 03:23:46.639911 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.639964 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.640692 (+ 728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.640960 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.640963 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.641272 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.641467 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.641470 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.642650 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.642651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.643363 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.643365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.643842 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.643844 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.644009 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.644790 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.644794 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.647201 (+ 2407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.649895 (+ 2694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.649896 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.649896 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.650134 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.650345 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.650346 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.650346 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.650413 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.650800 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.650801 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.650842 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.651304 (+ 462us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.651413 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":1,"thread_start_us":75,"threads_started":1}
I20260809 03:23:46.652134 15783 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33131
I20260809 03:23:46.652228 15783 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:46.652303 15784 heartbeater.cc:347] Connected to a master server at 127.8.5.252:45619
I20260809 03:23:46.652333 15784 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:46.652417 15783 heartbeater.cc:511] Master 127.8.5.254:33131 requested a full tablet report, sending...
I20260809 03:23:46.652416 15784 heartbeater.cc:511] Master 127.8.5.252:45619 requested a full tablet report, sending...
I20260809 03:23:46.652905 15597 ts_manager.cc:194] Registered new tserver with Master: 73eaa15098d547f5ac2372300461ef7e (127.8.5.193:33243)
I20260809 03:23:46.653122 14760 ts_manager.cc:194] Re-registered known tserver with Master: 73eaa15098d547f5ac2372300461ef7e (127.8.5.193:33243)
I20260809 03:23:46.653499 14760 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:44517
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.253@KRBTEST.COM
I20260809 03:23:46.659842 15454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.640095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:42299 (local address 127.8.5.253:38551)
0809 03:23:46.640141 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.640143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.640218 (+ 75us) server_negotiation.cc:407] Connection header received
0809 03:23:46.640815 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.640817 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.640829 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.640862 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.641585 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.642090 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.643525 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.643833 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.643899 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.657241 (+ 13342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.657243 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.657243 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.657252 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.658581 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.658921 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.658922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.658923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.659001 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.659256 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.659257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.659257 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.659419 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.659485 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.659652 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.659734 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:23:46.659858 15790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.640021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38551 (local address 127.8.5.193:42299)
0809 03:23:46.640159 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.640170 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.640709 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.640969 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.640970 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.641315 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.641468 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.641474 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.642190 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.642191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.643402 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.643405 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.643944 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.643945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.644009 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.655989 (+ 11980us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.655994 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.657140 (+ 1146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.658664 (+ 1524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.658665 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.658665 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.658837 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.659101 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.659102 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.659103 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.659180 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.659493 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.659494 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.659536 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.659626 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.659735 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":37,"thread_start_us":86,"threads_started":1}
I20260809 03:23:46.660005 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:40113
--local_ip_for_outbound_sockets=127.8.5.194
--tserver_master_addrs=127.8.5.254:33131
--webserver_port=36877
--webserver_interface=127.8.5.194
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.194.keytab
--principal=oryx/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:42821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.8.5.254:33131,127.8.5.253:38551
--tserver_master_addrs=127.8.5.254:33131,127.8.5.253:38551,127.8.5.252:45619 with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 03:23:46.660159 15785 heartbeater.cc:347] Connected to a master server at 127.8.5.253:38551
I20260809 03:23:46.660202 15785 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:46.660276 15785 heartbeater.cc:511] Master 127.8.5.253:38551 requested a full tablet report, sending...
I20260809 03:23:46.660670 15398 ts_manager.cc:194] Registered new tserver with Master: 73eaa15098d547f5ac2372300461ef7e (127.8.5.193:33243)
W20260809 03:23:46.742292 15792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:46.742488 15792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:46.742511 15792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:46.743678 15792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:46.743718 15792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:46.743742 15792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:23:46.745168 15792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:42821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.194.keytab
--principal=oryx/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:40113
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=36877
--tserver_master_addrs=127.8.5.254:33131,127.8.5.253:38551,127.8.5.252:45619
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:46.745405 15792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:46.745635 15792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:46.750666 15798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:46.750674 15800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:46.750720 15797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:46.751003 15792 server_base.cc:1034] running on GCE node
I20260809 03:23:46.751206 15792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:46.751418 15792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:46.752552 15792 hybrid_clock.cc:648] HybridClock initialized: now 1786245826752538 us; error 32 us; skew 500 ppm
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:46.754915 15792 init.cc:377] Logged in from keytab as oryx/127.8.5.194@KRBTEST.COM (short username oryx)
I20260809 03:23:46.755330 15792 webserver.cc:460] Webserver started at http://127.8.5.194:36877/ using document root <none> and password file <none>
I20260809 03:23:46.755505 15792 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:46.755558 15792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:46.756811 15792 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:23:46.757306 15807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.757504 15792 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.757596 15792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "c1b9e89fd789450384d19508e2a23094"
format_stamp: "Formatted at 2026-08-09 03:23:45 on dist-test-slave-2w3w"
server_key: "7b82f090f0e4125a504e68fdb1a4763f"
server_key_iv: "448eebf2afde92be88e095ad5f41f8da"
server_key_version: "encryptionkey@0"
I20260809 03:23:46.757925 15792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:46.776227 15792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:46.778029 15792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:46.778177 15792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:46.778424 15792 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:46.778733 15792 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:46.778782 15792 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.778831 15792 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:46.778872 15792 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.784782 15792 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:40113
I20260809 03:23:46.784837 15927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:40113 every 8 connection(s)
I20260809 03:23:46.785180 15792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.252@KRBTEST.COM
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.253@KRBTEST.COM
I20260809 03:23:46.795315 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 15792
I20260809 03:23:46.795476 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 15113
I20260809 03:23:46.797313 14824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.785908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:45525 (local address 127.8.5.254:33131)
0809 03:23:46.785969 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.785972 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.786253 (+ 281us) server_negotiation.cc:407] Connection header received
0809 03:23:46.787717 (+ 1464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.787718 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.787734 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.787800 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.788624 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.789387 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.790577 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.790913 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.791001 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.793701 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.793702 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.793702 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.793710 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.795505 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.796024 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.796025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.796026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.796099 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.796435 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.796436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.796437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.796573 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.796620 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.797067 (+ 447us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.797170 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 03:23:46.798058 15932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.785907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.194:45525)
0809 03:23:46.786118 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.786164 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.787582 (+ 1418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.787872 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.787877 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.788353 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.788511 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.788517 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.789467 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.789468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.790474 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.790476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.791063 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.791064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.791141 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.792081 (+ 940us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.792085 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.793609 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.795598 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.795606 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.795608 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.795929 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.796183 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.796184 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.796184 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.796352 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.796661 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.796668 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.796886 (+ 218us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.797478 (+ 592us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.797714 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":23,"thread_start_us":122,"threads_started":1}
I20260809 03:23:46.799137 15933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.785909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:45619 (local address 127.8.5.194:35277)
0809 03:23:46.786222 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.786232 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.787581 (+ 1349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.787886 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.787887 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.788349 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.788511 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.788517 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.790577 (+ 2060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.790578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.791205 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.791207 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.791628 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.791629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.791714 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.792100 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.792104 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.794381 (+ 2277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.797897 (+ 3516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.797898 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.797898 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.798070 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.798468 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.798469 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.798470 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.798524 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.798843 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.798844 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.798878 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.798940 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.799074 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":17,"thread_start_us":105,"threads_started":1}
I20260809 03:23:46.799263 15788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.786368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:35277 (local address 127.8.5.252:45619)
0809 03:23:46.786428 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.786430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.786440 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:23:46.787775 (+ 1335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.787776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.787794 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.787841 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.788625 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.789394 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.791312 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.791538 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.791617 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.794515 (+ 2898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.794516 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.794517 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.794524 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.797797 (+ 3273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.798308 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.798309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.798310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.798387 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.798588 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.798589 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.798590 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.798762 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.798859 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.798997 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.799113 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 03:23:46.799621 15929 heartbeater.cc:347] Connected to a master server at 127.8.5.252:45619
I20260809 03:23:46.799754 15929 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:46.800019 15929 heartbeater.cc:511] Master 127.8.5.252:45619 requested a full tablet report, sending...
I20260809 03:23:46.800506 15597 ts_manager.cc:194] Registered new tserver with Master: c1b9e89fd789450384d19508e2a23094 (127.8.5.194:40113)
I20260809 03:23:46.804325 15928 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33131
I20260809 03:23:46.805384 15928 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:46.805508 15928 heartbeater.cc:511] Master 127.8.5.254:33131 requested a full tablet report, sending...
I20260809 03:23:46.805781 14760 ts_manager.cc:194] Re-registered known tserver with Master: c1b9e89fd789450384d19508e2a23094 (127.8.5.194:40113)
I20260809 03:23:46.806231 15454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.786472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:37869 (local address 127.8.5.253:38551)
0809 03:23:46.786549 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.786551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.786563 (+ 12us) server_negotiation.cc:407] Connection header received
0809 03:23:46.787772 (+ 1209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.787773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.787786 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.787819 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.788621 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.789117 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.790577 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.790885 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.790985 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.794840 (+ 3855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.794842 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.794842 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.794851 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.804944 (+ 10093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.805333 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.805334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.805334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.805392 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.805698 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.805699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.805699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.805805 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.805885 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.806058 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.806136 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 03:23:46.806344 14760 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:45525
I20260809 03:23:46.806257 15934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.786217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38551 (local address 127.8.5.194:37869)
0809 03:23:46.786326 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.786338 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.787613 (+ 1275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.787890 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.787890 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.788303 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.788511 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.788515 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.789228 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.789229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.790474 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.790476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.791007 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.791008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.791143 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.791839 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.791850 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.794679 (+ 2829us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.805046 (+ 10367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.805047 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.805048 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.805240 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.805470 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.805470 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.805471 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.805530 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.805898 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.805899 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.805951 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.806033 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.806138 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"mutex_wait_us":6,"thread_start_us":70,"threads_started":1}
I20260809 03:23:46.806721 15930 heartbeater.cc:347] Connected to a master server at 127.8.5.253:38551
I20260809 03:23:46.806770 15930 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:46.806849 15930 heartbeater.cc:511] Master 127.8.5.253:38551 requested a full tablet report, sending...
I20260809 03:23:46.807193 15398 ts_manager.cc:194] Registered new tserver with Master: c1b9e89fd789450384d19508e2a23094 (127.8.5.194:40113)
I20260809 03:23:46.808739 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:44749
--local_ip_for_outbound_sockets=127.8.5.195
--tserver_master_addrs=127.8.5.254:33131
--webserver_port=36763
--webserver_interface=127.8.5.195
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.195.keytab
--principal=oryx/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:42821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.8.5.254:33131,127.8.5.253:38551
--tserver_master_addrs=127.8.5.254:33131,127.8.5.253:38551,127.8.5.252:45619 with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:46.891122 15936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:46.891314 15936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:46.891338 15936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:46.892443 15936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:46.892477 15936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:46.892503 15936 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:23:46.893898 15936 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:42821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.195.keytab
--principal=oryx/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:44749
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=36763
--tserver_master_addrs=127.8.5.254:33131,127.8.5.253:38551,127.8.5.252:45619
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15936
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:46.894075 15936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:46.894243 15936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:46.899204 15942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:46.899201 15941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:46.899266 15944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:46.899451 15936 server_base.cc:1034] running on GCE node
I20260809 03:23:46.899698 15936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:46.899914 15936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:46.901240 15936 hybrid_clock.cc:648] HybridClock initialized: now 1786245826901228 us; error 27 us; skew 500 ppm
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:46.904058 15936 init.cc:377] Logged in from keytab as oryx/127.8.5.195@KRBTEST.COM (short username oryx)
I20260809 03:23:46.904488 15936 webserver.cc:460] Webserver started at http://127.8.5.195:36763/ using document root <none> and password file <none>
I20260809 03:23:46.904721 15936 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:46.904810 15936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:46.906188 15936 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:23:46.906919 15952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.907131 15936 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:23:46.907239 15936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "fd526f4d67ce431499d420aaec9e6708"
format_stamp: "Formatted at 2026-08-09 03:23:45 on dist-test-slave-2w3w"
server_key: "4085acbe436ec3c00ccc1f996659df95"
server_key_iv: "5f8512cd313a201f2cad41536b419919"
server_key_version: "encryptionkey@0"
I20260809 03:23:46.907615 15936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:46.924292 15936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:46.926635 15936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:46.926806 15936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:46.927086 15936 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:46.927397 15936 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:46.927450 15936 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.927495 15936 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:46.927521 15936 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:46.933482 15936 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:44749
I20260809 03:23:46.933560 16070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:44749 every 8 connection(s)
I20260809 03:23:46.933902 15936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:23:46.934062 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 15936
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM
I20260809 03:23:46.945801 15788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.935520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58600 (local address 127.8.5.252:45619)
0809 03:23:46.935564 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.935566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.935793 (+ 227us) server_negotiation.cc:407] Connection header received
0809 03:23:46.935890 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.935891 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.935903 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.935934 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.936829 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.937602 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.938685 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.939000 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.939043 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.941418 (+ 2375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.941419 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.941419 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.941426 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.943943 (+ 2517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.944673 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.944674 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.944675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.944739 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.945136 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.945137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.945138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.945274 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.945354 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.945590 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.945687 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:23:46.945828 15454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.935219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44766 (local address 127.8.5.253:38551)
0809 03:23:46.935352 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.935354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.935616 (+ 262us) server_negotiation.cc:407] Connection header received
0809 03:23:46.935713 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.935714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.935727 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.935782 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.936642 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.937411 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.939699 (+ 2288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.940006 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.940054 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.941528 (+ 1474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.941529 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.941530 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.941537 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.943535 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.944823 (+ 1288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.944824 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.944825 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.944892 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.945221 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.945222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.945222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.945359 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.945432 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.945658 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.945734 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.253@KRBTEST.COM
I20260809 03:23:46.947515 16080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.935181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53284 (local address 127.8.5.254:33131)
0809 03:23:46.935368 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.935371 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.935695 (+ 324us) server_negotiation.cc:407] Connection header received
0809 03:23:46.935803 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.935804 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.935818 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.935866 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.936642 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.937423 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.938619 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.938911 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.938951 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.940809 (+ 1858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.940811 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.940811 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.940818 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.943579 (+ 2761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.944853 (+ 1274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.944854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.944854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.944918 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.946636 (+ 1718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.946637 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.946638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.946778 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.946856 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.947282 (+ 426us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.947371 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":115,"threads_started":1}
I20260809 03:23:46.948788 16078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.934654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.195:42613)
0809 03:23:46.935112 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.935159 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.935899 (+ 740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.936106 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.936111 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.936962 (+ 851us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.937217 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.937223 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.939455 (+ 2232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.939456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.940867 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.940871 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.941422 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.941423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.941563 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.943021 (+ 1458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.943031 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.945077 (+ 2046us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.946977 (+ 1900us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.946983 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.946985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.947318 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.947560 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.947560 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.947561 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.947687 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.948004 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.948012 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.948171 (+ 159us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.948281 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.948538 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":110,"threads_started":1}
I20260809 03:23:46.949110 14824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.934675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:42613 (local address 127.8.5.254:33131)
0809 03:23:46.934732 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.934747 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.935240 (+ 493us) server_negotiation.cc:407] Connection header received
0809 03:23:46.935988 (+ 748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.935989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.935998 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.936036 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.938004 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.938660 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.940979 (+ 2319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.941287 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.941333 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.945180 (+ 3847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.945181 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.945182 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.945188 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.946862 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.947417 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.947418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.947418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.947487 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.947769 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.947770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.947770 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.947913 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.947976 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.948776 (+ 800us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.949012 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 03:23:46.949469 16071 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33131
I20260809 03:23:46.949559 16071 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:46.949761 16071 heartbeater.cc:511] Master 127.8.5.254:33131 requested a full tablet report, sending...
Aug 09 03:23:46 dist-test-slave-2w3w krb5kdc[14716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245826, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.252@KRBTEST.COM
I20260809 03:23:46.952035 16086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.937785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:55813 (local address 127.8.5.253:38551)
0809 03:23:46.938136 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.938138 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.938144 (+ 6us) server_negotiation.cc:407] Connection header received
0809 03:23:46.938163 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.938164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.938174 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.938226 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.938609 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.939337 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.943733 (+ 4396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.944078 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.944147 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.947526 (+ 3379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.947528 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.947528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.947535 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.950287 (+ 2752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.951045 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.951046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.951047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.951113 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.951396 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.951398 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.951398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.951535 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.951599 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.951862 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.951948 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":55,"threads_started":1}
I20260809 03:23:46.952049 16085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.937591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38551 (local address 127.8.5.195:55813)
0809 03:23:46.937896 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.937907 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.937952 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.938265 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.938266 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.938459 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.938527 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.938529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.939451 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.939452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.942846 (+ 3394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.942849 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.944197 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.944198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.944266 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.945471 (+ 1205us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.945477 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.947430 (+ 1953us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.950390 (+ 2960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.950391 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.950392 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.950648 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.951213 (+ 565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.951214 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.951214 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.951283 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.951666 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.951667 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.951715 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.951806 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.951913 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":2224,"thread_start_us":79,"threads_started":1}
I20260809 03:23:46.952509 16073 heartbeater.cc:347] Connected to a master server at 127.8.5.253:38551
I20260809 03:23:46.952567 16073 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:46.950297 14760 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53284:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 03:23:46.952643 16073 heartbeater.cc:511] Master 127.8.5.253:38551 requested a full tablet report, sending...
W20260809 03:23:46.952800 14760 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:23:46.952998 15398 ts_manager.cc:194] Registered new tserver with Master: fd526f4d67ce431499d420aaec9e6708 (127.8.5.195:44749)
I20260809 03:23:46.953337 14761 ts_manager.cc:194] Re-registered known tserver with Master: fd526f4d67ce431499d420aaec9e6708 (127.8.5.195:44749)
I20260809 03:23:46.953799 14761 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:42613
I20260809 03:23:46.954183 16084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.937758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:45619 (local address 127.8.5.195:52413)
0809 03:23:46.938024 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.938032 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.938064 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.941911 (+ 3847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.941912 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.942124 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:46.942532 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.942534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.944470 (+ 1936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.944471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.945346 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.945349 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.947828 (+ 2479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.947829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.947895 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.948410 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:46.948415 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:46.950117 (+ 1702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:46.951955 (+ 1838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.951955 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.951956 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.952625 (+ 669us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.953139 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:46.953139 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:46.953140 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:46.953205 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:46.953663 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:46.953663 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:46.953724 (+ 61us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.953789 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.953887 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":56,"threads_started":1}
I20260809 03:23:46.954566 16087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.937912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:52413 (local address 127.8.5.252:45619)
0809 03:23:46.941729 (+ 3817us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.941731 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.941738 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:23:46.941758 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.941758 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.941771 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.941914 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:46.942625 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.944400 (+ 1775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.946704 (+ 2304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.947053 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.947111 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.950213 (+ 3102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:46.950214 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:46.950215 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:46.950222 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:46.951875 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.952938 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.952939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.952939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.953011 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:46.953285 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:46.953285 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:46.953286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:46.953420 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:46.953617 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.954378 (+ 761us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.954467 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3797,"thread_start_us":52,"threads_started":1}
I20260809 03:23:46.955065 16072 heartbeater.cc:347] Connected to a master server at 127.8.5.252:45619
I20260809 03:23:46.955124 16072 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:46.955196 16072 heartbeater.cc:511] Master 127.8.5.252:45619 requested a full tablet report, sending...
I20260809 03:23:46.955470 15597 ts_manager.cc:194] Registered new tserver with Master: fd526f4d67ce431499d420aaec9e6708 (127.8.5.195:44749)
I20260809 03:23:46.960638 16093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.956930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:33243 (local address 127.0.0.1:59748)
0809 03:23:46.957329 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.957339 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.957378 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.957936 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.957937 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.957939 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:46.957983 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.957985 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.958780 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.958781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.959703 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.959706 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.960381 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.960382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.960443 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.960449 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.960525 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.960565 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"mutex_wait_us":1,"thread_start_us":87,"threads_started":1}
I20260809 03:23:46.960654 16096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.957350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59748 (local address 127.8.5.193:33243)
0809 03:23:46.957731 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.957735 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.957744 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:23:46.957821 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.957823 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.957835 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.957926 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:46.958047 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.958686 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.959796 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.960277 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.960376 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.960457 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.960539 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.960577 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":68,"threads_started":1}
I20260809 03:23:46.961508 16094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.956911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:40113 (local address 127.0.0.1:40434)
0809 03:23:46.957159 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.957168 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.957221 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.957551 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.957551 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.957554 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:46.957613 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.957615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.959200 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.959201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.960265 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.960267 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.961260 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.961262 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.961331 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.961335 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.961382 (+ 47us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.961421 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":94,"threads_started":1}
I20260809 03:23:46.961601 15355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.956799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:44749 (local address 127.0.0.1:47954)
0809 03:23:46.956869 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:46.956880 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:46.956923 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:46.957629 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:46.957630 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:46.957631 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:46.957661 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.957662 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.958943 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.958944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.960108 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:46.960111 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.961404 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.961405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:46.961456 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.961459 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:23:46.961495 (+ 36us) client_negotiation.cc:240] Negotiation successful
0809 03:23:46.961533 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":1}
I20260809 03:23:46.961726 15714 tablet_service.cc:1467] Processing CreateTablet for tablet f84263287ba444e19af8f9762e18d61c (DEFAULT_TABLE table=test-table [id=f626bedc6a4d4eb382631eedc591bc14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:46.961956 16092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.956862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47954 (local address 127.8.5.195:44749)
0809 03:23:46.957485 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.957489 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.957497 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:23:46.957528 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.957530 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.957543 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.957617 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:46.957741 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.958841 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.960204 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.961313 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.961395 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.961805 (+ 410us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.961838 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.961876 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":84,"threads_started":1}
I20260809 03:23:46.962154 15714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f84263287ba444e19af8f9762e18d61c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:46.963371 16095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:46.957152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40434 (local address 127.8.5.194:40113)
0809 03:23:46.957363 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:46.957367 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:46.957378 (+ 11us) server_negotiation.cc:407] Connection header received
0809 03:23:46.957421 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:46.957424 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:46.957443 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:46.957532 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:46.957710 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.959113 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.960353 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:46.961111 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:46.961189 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:46.963209 (+ 2020us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:46.963238 (+ 29us) server_negotiation.cc:299] Negotiation successful
0809 03:23:46.963284 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":94,"threads_started":1}
I20260809 03:23:46.963666 16003 tablet_service.cc:1467] Processing CreateTablet for tablet f84263287ba444e19af8f9762e18d61c (DEFAULT_TABLE table=test-table [id=f626bedc6a4d4eb382631eedc591bc14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:46.963981 16003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f84263287ba444e19af8f9762e18d61c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:46.965636 16097 tablet_bootstrap.cc:492] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e: Bootstrap starting.
I20260809 03:23:46.965883 15859 tablet_service.cc:1467] Processing CreateTablet for tablet f84263287ba444e19af8f9762e18d61c (DEFAULT_TABLE table=test-table [id=f626bedc6a4d4eb382631eedc591bc14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:46.966190 15859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f84263287ba444e19af8f9762e18d61c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:46.966516 16097 tablet_bootstrap.cc:654] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:46.966874 16097 log.cc:824] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:46.967720 16097 tablet_bootstrap.cc:492] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e: No bootstrap required, opened a new log
I20260809 03:23:46.967821 16097 ts_tablet_manager.cc:1397] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260809 03:23:46.969208 16101 tablet_bootstrap.cc:492] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094: Bootstrap starting.
I20260809 03:23:46.969882 16097 raft_consensus.cc:348] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } } peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } }
I20260809 03:23:46.970060 16097 raft_consensus.cc:374] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:46.970082 16101 tablet_bootstrap.cc:654] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:46.970103 16097 raft_consensus.cc:729] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73eaa15098d547f5ac2372300461ef7e, State: Initialized, Role: FOLLOWER
I20260809 03:23:46.970242 16097 consensus_queue.cc:260] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } } peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } }
I20260809 03:23:46.970522 16101 log.cc:824] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:46.970615 16097 ts_tablet_manager.cc:1428] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 03:23:46.970649 15783 heartbeater.cc:503] Master 127.8.5.254:33131 was elected leader, sending a full tablet report...
I20260809 03:23:46.970938 16100 tablet_bootstrap.cc:492] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708: Bootstrap starting.
I20260809 03:23:46.971355 16101 tablet_bootstrap.cc:492] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094: No bootstrap required, opened a new log
I20260809 03:23:46.971423 16101 ts_tablet_manager.cc:1397] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:23:46.972397 16100 tablet_bootstrap.cc:654] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:46.972795 16100 log.cc:824] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:46.973601 16100 tablet_bootstrap.cc:492] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708: No bootstrap required, opened a new log
I20260809 03:23:46.973670 16100 ts_tablet_manager.cc:1397] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260809 03:23:46.973862 16101 raft_consensus.cc:348] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } } peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } }
I20260809 03:23:46.974018 16101 raft_consensus.cc:374] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:46.974056 16101 raft_consensus.cc:729] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1b9e89fd789450384d19508e2a23094, State: Initialized, Role: FOLLOWER
I20260809 03:23:46.974339 16101 consensus_queue.cc:260] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } } peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } }
I20260809 03:23:46.974721 16101 ts_tablet_manager.cc:1428] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 03:23:46.974756 15928 heartbeater.cc:503] Master 127.8.5.254:33131 was elected leader, sending a full tablet report...
I20260809 03:23:46.976377 16100 raft_consensus.cc:348] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } } peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } }
I20260809 03:23:46.976491 16100 raft_consensus.cc:374] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:46.976512 16100 raft_consensus.cc:729] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd526f4d67ce431499d420aaec9e6708, State: Initialized, Role: FOLLOWER
I20260809 03:23:46.976614 16100 consensus_queue.cc:260] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } } peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } }
I20260809 03:23:46.976833 16100 ts_tablet_manager.cc:1428] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260809 03:23:46.976886 16071 heartbeater.cc:503] Master 127.8.5.254:33131 was elected leader, sending a full tablet report...
I20260809 03:23:47.029877 16087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:47.027405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58612 (local address 127.8.5.252:45619)
0809 03:23:47.027454 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:47.027456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:47.027465 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:23:47.027500 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:47.027500 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:47.027523 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:47.027592 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:47.027704 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.028192 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.029208 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.029617 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.029677 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:47.029732 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:47.029787 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 03:23:47.029816 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 03:23:47.029902 16094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:47.027285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:45619 (local address 127.0.0.1:58612)
0809 03:23:47.027376 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:47.027387 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:47.027438 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:47.027605 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:47.027606 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:47.027607 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:47.027655 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:47.027657 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.028273 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.028274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:47.029084 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:47.029087 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.029689 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.029690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:47.029738 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:47.029742 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:23:47.029782 (+ 40us) client_negotiation.cc:240] Negotiation successful
0809 03:23:47.029844 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 03:23:47.030511 15607 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260809 03:23:47.031548 15636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 775fc7fbd9ce4ed98bcff9377b58c161. Latest consensus state: current_term: 1 leader_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: NON_VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: true } } }
I20260809 03:23:47.031656 15636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [sys.catalog]: This master's current role is: LEARNER
W20260809 03:23:47.036150 15931 tablet.cc:2369] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:23:47.096730 16105 raft_consensus.cc:482] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:23:47.096848 16105 raft_consensus.cc:504] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } } peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } }
I20260809 03:23:47.097275 16105 leader_election.cc:288] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd526f4d67ce431499d420aaec9e6708 (127.8.5.195:44749), 73eaa15098d547f5ac2372300461ef7e (127.8.5.193:33243)
I20260809 03:23:47.101333 16096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:47.097618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:57763 (local address 127.8.5.193:33243)
0809 03:23:47.097691 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:47.097693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:47.097789 (+ 96us) server_negotiation.cc:407] Connection header received
0809 03:23:47.097816 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:47.097817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:47.097830 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:47.097906 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:47.098045 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.098796 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.100384 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.100962 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.101038 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:47.101048 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:47.101223 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 03:23:47.101264 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 03:23:47.101333 16092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:47.097570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:43229 (local address 127.8.5.195:44749)
0809 03:23:47.097622 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:47.097629 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:47.097659 (+ 30us) server_negotiation.cc:407] Connection header received
0809 03:23:47.097719 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:47.097720 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:47.097738 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:47.097818 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:47.098034 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.098798 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.100397 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.100961 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.101039 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:47.101048 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:47.101220 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 03:23:47.101260 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 03:23:47.101341 15933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:47.097504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:44749 (local address 127.8.5.194:43229)
0809 03:23:47.097590 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:47.097604 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:47.097651 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:47.097844 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:47.097844 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:47.097846 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:47.097939 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:47.097941 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.098895 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.098896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:47.100295 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:47.100297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.101047 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.101048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:47.101136 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:47.101140 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:23:47.101202 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 03:23:47.101253 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65,"mutex_wait_us":121}
I20260809 03:23:47.101352 15934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:47.097540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:33243 (local address 127.8.5.194:57763)
0809 03:23:47.097720 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:47.097727 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:47.097754 (+ 27us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:47.097926 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:47.097927 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:47.097928 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:47.097978 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:47.097979 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.098895 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.098896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:47.100290 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:47.100294 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.101047 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.101048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:47.101136 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:47.101140 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:23:47.101202 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 03:23:47.101253 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":83}
I20260809 03:23:47.101975 16024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f84263287ba444e19af8f9762e18d61c" candidate_uuid: "c1b9e89fd789450384d19508e2a23094" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd526f4d67ce431499d420aaec9e6708" is_pre_election: true
I20260809 03:23:47.102159 16024 raft_consensus.cc:2454] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1b9e89fd789450384d19508e2a23094 in term 0.
I20260809 03:23:47.102291 15734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f84263287ba444e19af8f9762e18d61c" candidate_uuid: "c1b9e89fd789450384d19508e2a23094" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73eaa15098d547f5ac2372300461ef7e" is_pre_election: true
I20260809 03:23:47.102465 15734 raft_consensus.cc:2454] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1b9e89fd789450384d19508e2a23094 in term 0.
I20260809 03:23:47.102648 15808 leader_election.cc:302] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1b9e89fd789450384d19508e2a23094, fd526f4d67ce431499d420aaec9e6708; no voters:
I20260809 03:23:47.102767 16105 raft_consensus.cc:2781] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:23:47.102851 16105 raft_consensus.cc:482] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:23:47.102870 16105 raft_consensus.cc:3037] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:47.103693 16105 raft_consensus.cc:504] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } } peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } }
I20260809 03:23:47.103839 16105 leader_election.cc:288] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [CANDIDATE]: Term 1 election: Requested vote from peers fd526f4d67ce431499d420aaec9e6708 (127.8.5.195:44749), 73eaa15098d547f5ac2372300461ef7e (127.8.5.193:33243)
I20260809 03:23:47.103995 15734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f84263287ba444e19af8f9762e18d61c" candidate_uuid: "c1b9e89fd789450384d19508e2a23094" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73eaa15098d547f5ac2372300461ef7e"
I20260809 03:23:47.104032 16024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f84263287ba444e19af8f9762e18d61c" candidate_uuid: "c1b9e89fd789450384d19508e2a23094" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd526f4d67ce431499d420aaec9e6708"
I20260809 03:23:47.104107 15734 raft_consensus.cc:3037] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:47.104103 16024 raft_consensus.cc:3037] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:47.104830 16024 raft_consensus.cc:2454] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1b9e89fd789450384d19508e2a23094 in term 1.
I20260809 03:23:47.104954 15734 raft_consensus.cc:2454] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1b9e89fd789450384d19508e2a23094 in term 1.
I20260809 03:23:47.104997 15808 leader_election.cc:302] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1b9e89fd789450384d19508e2a23094, fd526f4d67ce431499d420aaec9e6708; no voters:
I20260809 03:23:47.105072 16105 raft_consensus.cc:2781] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:47.105222 16105 raft_consensus.cc:686] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [term 1 LEADER]: Becoming Leader. State: Replica: c1b9e89fd789450384d19508e2a23094, State: Running, Role: LEADER
I20260809 03:23:47.105343 16105 consensus_queue.cc:237] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } } peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } }
I20260809 03:23:47.106202 14760 catalog_manager.cc:5495] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1b9e89fd789450384d19508e2a23094 (127.8.5.194). New cstate: current_term: 1 leader_uuid: "c1b9e89fd789450384d19508e2a23094" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } health_report { overall_health: UNKNOWN } } }
I20260809 03:23:47.106777 15356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: NON_VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: true } } }
I20260809 03:23:47.106884 15356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:47.107932 15357 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161: attempting to promote NON_VOTER 3aee4f6c7dbb4cbab49477116ed3acb5 to VOTER
I20260809 03:23:47.108052 15357 consensus_queue.cc:237] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false } }
I20260809 03:23:47.108626 15408 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 1 FOLLOWER]: Refusing update from remote peer 775fc7fbd9ce4ed98bcff9377b58c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260809 03:23:47.108636 15607 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [term 1 LEARNER]: Refusing update from remote peer 775fc7fbd9ce4ed98bcff9377b58c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260809 03:23:47.108841 16112 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260809 03:23:47.108933 15356 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260809 03:23:47.109546 16112 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 3aee4f6c7dbb4cbab49477116ed3acb5 (127.8.5.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false } } }
I20260809 03:23:47.109700 15408 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 3aee4f6c7dbb4cbab49477116ed3acb5 (127.8.5.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false } } }
I20260809 03:23:47.110610 16112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false } } }
I20260809 03:23:47.110694 16112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:47.110754 16112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false } } }
I20260809 03:23:47.110802 16112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:47.110847 16112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false } } }
I20260809 03:23:47.110886 16112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:47.110903 15607 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 3aee4f6c7dbb4cbab49477116ed3acb5 (127.8.5.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false } } }
I20260809 03:23:47.111930 15636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false } } }
I20260809 03:23:47.111970 16114 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false } } }
I20260809 03:23:47.112031 15636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:23:47.112049 16114 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [sys.catalog]: This master's current role is: FOLLOWER
W20260809 03:23:47.140969 15786 tablet.cc:2369] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:23:47.142969 16095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:47.140653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40450 (local address 127.8.5.194:40113)
0809 03:23:47.140713 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:47.140715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:47.140726 (+ 11us) server_negotiation.cc:407] Connection header received
0809 03:23:47.140767 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:47.140768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:47.140802 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:47.140863 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:47.141022 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.141557 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.142275 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.142467 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.142517 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:47.142654 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:47.142744 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:47.142801 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:47.142843 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 03:23:47.142860 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 03:23:47.144765 15734 raft_consensus.cc:1261] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e [term 1 FOLLOWER]: Refusing update from remote peer c1b9e89fd789450384d19508e2a23094: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:47.144930 16024 raft_consensus.cc:1261] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708 [term 1 FOLLOWER]: Refusing update from remote peer c1b9e89fd789450384d19508e2a23094: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:47.145113 16110 consensus_queue.cc:1035] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:47.145236 16105 consensus_queue.cc:1035] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:47.149096 16116 mvcc.cc:205] Tried to move back new op lower bound from 7316462907982512128 to 7316462907824029696. Current Snapshot: MvccSnapshot[applied={T|T < 7316462907982512128 or (T in {7316462907982512128})}]
I20260809 03:23:47.149163 16117 mvcc.cc:205] Tried to move back new op lower bound from 7316462907982512128 to 7316462907824029696. Current Snapshot: MvccSnapshot[applied={T|T < 7316462907982512128}]
I20260809 03:23:47.150467 14760 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53284:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:47.150563 14760 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53284:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:47.151962 14760 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 775fc7fbd9ce4ed98bcff9377b58c161: Sending DeleteTablet for 3 replicas of tablet f84263287ba444e19af8f9762e18d61c
I20260809 03:23:47.152264 15859 tablet_service.cc:1514] Processing DeleteTablet for tablet f84263287ba444e19af8f9762e18d61c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:47 UTC) from {username='oryx', principal='oryx/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:40434
I20260809 03:23:47.152339 16003 tablet_service.cc:1514] Processing DeleteTablet for tablet f84263287ba444e19af8f9762e18d61c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:47 UTC) from {username='oryx', principal='oryx/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:47954
I20260809 03:23:47.152431 15714 tablet_service.cc:1514] Processing DeleteTablet for tablet f84263287ba444e19af8f9762e18d61c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:47 UTC) from {username='oryx', principal='oryx/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:59748
I20260809 03:23:47.152628 16128 tablet_replica.cc:330] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708: stopping tablet replica
I20260809 03:23:47.152730 16128 raft_consensus.cc:2229] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:47.152762 16127 tablet_replica.cc:330] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094: stopping tablet replica
I20260809 03:23:47.152842 16128 raft_consensus.cc:2258] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:47.152863 16127 raft_consensus.cc:2229] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:23:47.152967 16127 raft_consensus.cc:2258] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:47.153105 16129 tablet_replica.cc:330] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e: stopping tablet replica
I20260809 03:23:47.153198 16129 raft_consensus.cc:2229] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:47.153286 16129 raft_consensus.cc:2258] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:47.153649 16127 ts_tablet_manager.cc:1905] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:47.153918 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 14729
I20260809 03:23:47.154186 16128 ts_tablet_manager.cc:1905] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:47.154218 16129 ts_tablet_manager.cc:1905] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:47.157022 16128 ts_tablet_manager.cc:1918] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:23:47.157105 16128 log.cc:1196] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/f84263287ba444e19af8f9762e18d61c
I20260809 03:23:47.157413 16128 ts_tablet_manager.cc:1939] T f84263287ba444e19af8f9762e18d61c P fd526f4d67ce431499d420aaec9e6708: Deleting consensus metadata
I20260809 03:23:47.158618 16129 ts_tablet_manager.cc:1918] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:23:47.158699 16129 log.cc:1196] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-0/wal/wals/f84263287ba444e19af8f9762e18d61c
I20260809 03:23:47.158993 16129 ts_tablet_manager.cc:1939] T f84263287ba444e19af8f9762e18d61c P 73eaa15098d547f5ac2372300461ef7e: Deleting consensus metadata
I20260809 03:23:47.161006 16127 ts_tablet_manager.cc:1918] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:23:47.161128 16127 log.cc:1196] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/f84263287ba444e19af8f9762e18d61c
I20260809 03:23:47.161532 16127 ts_tablet_manager.cc:1939] T f84263287ba444e19af8f9762e18d61c P c1b9e89fd789450384d19508e2a23094: Deleting consensus metadata
W20260809 03:23:47.164078 15667 connection.cc:535] server connection from 127.0.0.1:59748 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 03:23:47.164086 15953 connection.cc:535] server connection from 127.0.0.1:47954 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 03:23:47.164263 15808 connection.cc:535] server connection from 127.0.0.1:40434 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 03:23:47.165521 16087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:47.153346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58616 (local address 127.8.5.252:45619)
0809 03:23:47.153387 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:47.153389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:47.153399 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:23:47.153420 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:47.153420 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:47.153431 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:47.153488 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:47.155040 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.155842 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.159213 (+ 3371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.159538 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.159586 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:47.161860 (+ 2274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:47.161861 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:47.161862 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:47.161869 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:47.163626 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:47.164500 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:47.164501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:47.164502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:47.164572 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:47.164857 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:47.164859 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:47.164859 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:47.165006 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:47.165119 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:47.165329 (+ 210us) server_negotiation.cc:299] Negotiation successful
0809 03:23:47.165416 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 03:23:47.173342 16087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:47.166337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58622 (local address 127.8.5.252:45619)
0809 03:23:47.166372 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:47.166374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:47.166431 (+ 57us) server_negotiation.cc:407] Connection header received
0809 03:23:47.166498 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:47.166500 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:47.166510 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:47.166565 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:47.167553 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.168010 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.168704 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.168907 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.168988 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:47.170481 (+ 1493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:47.170482 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:47.170482 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:47.170489 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:47.172150 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:47.172491 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:47.172492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:47.172492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:47.172548 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:47.172758 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:47.172759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:47.172760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:47.172890 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:47.172984 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:47.173175 (+ 191us) server_negotiation.cc:299] Negotiation successful
0809 03:23:47.173252 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:23:47.173946 16086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:47.166433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44774 (local address 127.8.5.253:38551)
0809 03:23:47.166478 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:47.166480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:47.166487 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:23:47.166507 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:47.166508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:47.166518 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:47.166568 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:47.167361 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.168139 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.169229 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:47.169518 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:47.169573 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:47.170914 (+ 1341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:47.170916 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:47.170916 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:47.170923 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:47.172660 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:47.173044 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:47.173045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:47.173046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:47.173096 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:47.173282 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:47.173283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:47.173283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:47.173405 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:47.173476 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:47.173730 (+ 254us) server_negotiation.cc:299] Negotiation successful
0809 03:23:47.173852 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:23:48.149503 16137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.149167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.195:51927)
0809 03:23:48.149321 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.149407 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":81,"threads_started":1}
I20260809 03:23:48.149662 16138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.149383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.194:47687)
0809 03:23:48.149535 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.149611 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":60,"threads_started":1}
W20260809 03:23:48.149744 16071 heartbeater.cc:644] Failed to heartbeat to 127.8.5.254:33131 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
W20260809 03:23:48.150002 15928 heartbeater.cc:644] Failed to heartbeat to 127.8.5.254:33131 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
I20260809 03:23:48.153009 16139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.152823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.193:46707)
0809 03:23:48.152924 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.152974 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":48,"threads_started":1}
W20260809 03:23:48.153190 15783 heartbeater.cc:644] Failed to heartbeat to 127.8.5.254:33131 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
I20260809 03:23:48.652550 16140 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 775fc7fbd9ce4ed98bcff9377b58c161)
I20260809 03:23:48.652683 16140 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false } }
I20260809 03:23:48.652967 16140 leader_election.cc:288] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 775fc7fbd9ce4ed98bcff9377b58c161 (127.8.5.254:33131), 3aee4f6c7dbb4cbab49477116ed3acb5 (127.8.5.252:45619)
I20260809 03:23:48.653007 16141 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 775fc7fbd9ce4ed98bcff9377b58c161)
I20260809 03:23:48.653326 16142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.653052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.0.0.1:36226)
0809 03:23:48.653209 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.653261 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":83,"threads_started":1}
I20260809 03:23:48.653281 16141 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false } }
W20260809 03:23:48.653455 15381 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
I20260809 03:23:48.653841 16142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.653753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.0.0.1:36248)
0809 03:23:48.653787 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.653814 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260809 03:23:48.653926 15381 leader_election.cc:334] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 775fc7fbd9ce4ed98bcff9377b58c161 (127.8.5.254:33131): Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
I20260809 03:23:48.653999 16141 leader_election.cc:288] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 775fc7fbd9ce4ed98bcff9377b58c161 (127.8.5.254:33131), c6fc776a10204ce79d77d9a2513cf23e (127.8.5.253:38551)
I20260809 03:23:48.654192 16146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.653597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.0.0.1:36236)
0809 03:23:48.653682 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.653745 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70,"thread_start_us":46,"threads_started":1}
W20260809 03:23:48.654399 15579 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
I20260809 03:23:48.654866 16146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.654725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.0.0.1:36254)
0809 03:23:48.654806 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.654834 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 03:23:48.654983 15579 leader_election.cc:334] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 775fc7fbd9ce4ed98bcff9377b58c161 (127.8.5.254:33131): Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
I20260809 03:23:48.656848 16144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.653277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60734 (local address 127.8.5.252:45619)
0809 03:23:48.653399 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:48.653401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:48.653591 (+ 190us) server_negotiation.cc:407] Connection header received
0809 03:23:48.653617 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:48.653618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:48.653629 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:48.653686 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:48.653923 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.654762 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.655928 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.656524 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.656603 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:48.656616 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:48.656748 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 03:23:48.656796 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":58,"threads_started":1}
I20260809 03:23:48.656870 16143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.653119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:45619 (local address 127.0.0.1:60734)
0809 03:23:48.653361 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.653470 (+ 109us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:48.653532 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:48.653739 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:48.653740 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:48.653742 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:48.653804 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:48.653807 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.654858 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.654859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:48.655833 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:48.655835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.656616 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.656616 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:48.656662 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:48.656665 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:23:48.656731 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 03:23:48.656773 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":72,"threads_started":1}
I20260809 03:23:48.657099 15607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6fc776a10204ce79d77d9a2513cf23e" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" is_pre_election: true
I20260809 03:23:48.657205 15607 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6fc776a10204ce79d77d9a2513cf23e in term 1.
I20260809 03:23:48.657368 15383 leader_election.cc:302] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3aee4f6c7dbb4cbab49477116ed3acb5, c6fc776a10204ce79d77d9a2513cf23e; no voters: 775fc7fbd9ce4ed98bcff9377b58c161
I20260809 03:23:48.657502 16140 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 03:23:48.657574 16140 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 775fc7fbd9ce4ed98bcff9377b58c161)
I20260809 03:23:48.657605 16140 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 1 FOLLOWER]: Advancing to term 2
I20260809 03:23:48.657608 16147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.653772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38551 (local address 127.0.0.1:57830)
0809 03:23:48.654142 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.654154 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:48.654229 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:48.654422 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:48.654423 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:48.654424 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:48.654480 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:48.654482 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.655430 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.655431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:48.656648 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:48.656650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.657326 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.657327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:48.657417 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:48.657423 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 03:23:48.657491 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 03:23:48.657539 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":34,"threads_started":1}
I20260809 03:23:48.658371 16140 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false } }
I20260809 03:23:48.658521 16140 leader_election.cc:288] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [CANDIDATE]: Term 2 election: Requested vote from peers 775fc7fbd9ce4ed98bcff9377b58c161 (127.8.5.254:33131), 3aee4f6c7dbb4cbab49477116ed3acb5 (127.8.5.252:45619)
I20260809 03:23:48.658689 15607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6fc776a10204ce79d77d9a2513cf23e" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5"
I20260809 03:23:48.658767 15607 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [term 1 FOLLOWER]: Advancing to term 2
I20260809 03:23:48.658728 16143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.658636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.0.0.1:36268)
0809 03:23:48.658674 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.658701 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260809 03:23:48.658990 16148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.653884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57830 (local address 127.8.5.253:38551)
0809 03:23:48.654079 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:48.654082 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:48.654232 (+ 150us) server_negotiation.cc:407] Connection header received
0809 03:23:48.654302 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:48.654303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:48.654313 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:48.654396 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:48.654545 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.655338 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.656723 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.657254 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.657324 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:48.657336 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:48.658840 (+ 1504us) server_negotiation.cc:299] Negotiation successful
0809 03:23:48.658890 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":89,"threads_started":1}
I20260809 03:23:48.659153 16143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.659058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.0.0.1:36284)
0809 03:23:48.659106 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.659129 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 03:23:48.659245 15381 leader_election.cc:334] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 775fc7fbd9ce4ed98bcff9377b58c161 (127.8.5.254:33131): Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
I20260809 03:23:48.659622 15607 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6fc776a10204ce79d77d9a2513cf23e in term 2.
I20260809 03:23:48.659729 15408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c6fc776a10204ce79d77d9a2513cf23e" is_pre_election: true
I20260809 03:23:48.659783 15383 leader_election.cc:302] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3aee4f6c7dbb4cbab49477116ed3acb5, c6fc776a10204ce79d77d9a2513cf23e; no voters: 775fc7fbd9ce4ed98bcff9377b58c161
I20260809 03:23:48.659852 15408 raft_consensus.cc:2379] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3aee4f6c7dbb4cbab49477116ed3acb5 in current term 2: Already voted for candidate c6fc776a10204ce79d77d9a2513cf23e in this term.
I20260809 03:23:48.659894 16140 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 2 FOLLOWER]: Leader election won for term 2
I20260809 03:23:48.660048 15581 leader_election.cc:302] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3aee4f6c7dbb4cbab49477116ed3acb5; no voters: 775fc7fbd9ce4ed98bcff9377b58c161, c6fc776a10204ce79d77d9a2513cf23e
I20260809 03:23:48.660056 16140 raft_consensus.cc:686] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [term 2 LEADER]: Becoming Leader. State: Replica: c6fc776a10204ce79d77d9a2513cf23e, State: Running, Role: LEADER
I20260809 03:23:48.660178 16141 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 03:23:48.660152 16140 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false } }
I20260809 03:23:48.660519 16150 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6fc776a10204ce79d77d9a2513cf23e. Latest consensus state: current_term: 2 leader_uuid: "c6fc776a10204ce79d77d9a2513cf23e" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false } } }
I20260809 03:23:48.660648 16150 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:48.660842 16152 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:48.661355 16152 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:48.661475 16152 catalog_manager.cc:1259] Loaded cluster ID: 384b17053f054eb2bbf5395ea2d70ae2
I20260809 03:23:48.661504 16152 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:23:48.661640 16152 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:48.661696 16152 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: Loaded TSK: 0
I20260809 03:23:48.661870 16152 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:23:48.710160 15397 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44774:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:23:48.712054 15397 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:23:48.713063 16143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.712938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.0.0.1:36308)
0809 03:23:48.713001 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.713030 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 03:23:48.713094 15607 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [term 2 FOLLOWER]: Refusing update from remote peer c6fc776a10204ce79d77d9a2513cf23e: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260809 03:23:48.713440 16143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.713301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.0.0.1:36314)
0809 03:23:48.713343 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.713379 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260809 03:23:48.713380 16150 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260809 03:23:48.713536 15381 consensus_peers.cc:487] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e -> Peer 775fc7fbd9ce4ed98bcff9377b58c161 (127.8.5.254:33131): Couldn't send request to peer 775fc7fbd9ce4ed98bcff9377b58c161. Status: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 03:23:48.714057 16141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6fc776a10204ce79d77d9a2513cf23e. Latest consensus state: current_term: 2 leader_uuid: "c6fc776a10204ce79d77d9a2513cf23e" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false } } }
I20260809 03:23:48.714171 16141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:23:48.714641 16150 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "c6fc776a10204ce79d77d9a2513cf23e" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false } } }
I20260809 03:23:48.714753 16150 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:48.715090 16141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "c6fc776a10204ce79d77d9a2513cf23e" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "775fc7fbd9ce4ed98bcff9377b58c161" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33131 } } peers { permanent_uuid: "c6fc776a10204ce79d77d9a2513cf23e" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38551 } attrs { promote: false } } peers { permanent_uuid: "3aee4f6c7dbb4cbab49477116ed3acb5" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 45619 } attrs { promote: false } } }
I20260809 03:23:48.715204 16141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3aee4f6c7dbb4cbab49477116ed3acb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:23:48.719969 16162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.716655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60440 (local address 127.8.5.193:33243)
0809 03:23:48.716853 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:48.716856 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:48.716864 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:23:48.716891 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:48.716891 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:48.716905 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:48.717111 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:48.717156 (+ 45us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.717618 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.718958 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.719624 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.719705 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:48.719719 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:48.719843 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 03:23:48.719890 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":72,"threads_started":1}
I20260809 03:23:48.719973 16143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.716474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:33243 (local address 127.0.0.1:60440)
0809 03:23:48.716599 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.716607 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:48.716634 (+ 27us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:48.716997 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:48.716998 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:48.717000 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:48.717048 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:48.717050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.717701 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.717702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:48.718803 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:48.718805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.719711 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.719712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:48.719772 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:48.719779 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 03:23:48.719837 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 03:23:48.719878 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":72,"threads_started":1}
I20260809 03:23:48.720127 16160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.716542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32886 (local address 127.8.5.194:40113)
0809 03:23:48.716869 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:48.716871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:48.716880 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:23:48.716905 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:48.716906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:48.716916 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:48.717100 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:48.717143 (+ 43us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.717880 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.719125 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.719684 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.719777 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:48.719788 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:48.720009 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 03:23:48.720059 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":52,"threads_started":1}
I20260809 03:23:48.720351 15714 tablet_service.cc:1467] Processing CreateTablet for tablet 146d538b4b694674a91094edd2a60a73 (DEFAULT_TABLE table=test-table [id=a968583cc1b240f1bbc8375c76bd0e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:48.720501 15714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 146d538b4b694674a91094edd2a60a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:48.720527 16142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.716413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:40113 (local address 127.0.0.1:32886)
0809 03:23:48.716478 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.716489 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:48.716537 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:48.717002 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:48.717003 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:48.717005 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:48.717039 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:48.717040 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.717961 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.717961 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:48.719046 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:48.719048 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.719785 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.719786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:48.719872 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:48.719876 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:23:48.719926 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 03:23:48.719966 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":1}
I20260809 03:23:48.720772 15859 tablet_service.cc:1467] Processing CreateTablet for tablet 146d538b4b694674a91094edd2a60a73 (DEFAULT_TABLE table=test-table [id=a968583cc1b240f1bbc8375c76bd0e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:48.720893 15859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 146d538b4b694674a91094edd2a60a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:48.720999 16159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.716413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:44749 (local address 127.0.0.1:40524)
0809 03:23:48.716578 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.716590 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:48.716638 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:48.716915 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:48.716916 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:48.716918 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:48.716980 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:48.716982 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.719119 (+ 2137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.719120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:48.719888 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:48.719890 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.720764 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.720765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:48.720852 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:48.720857 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 03:23:48.720891 (+ 34us) client_negotiation.cc:240] Negotiation successful
0809 03:23:48.720933 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":29}
I20260809 03:23:48.721367 16161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.716641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40524 (local address 127.8.5.195:44749)
0809 03:23:48.716758 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:48.716760 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:48.716767 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:23:48.716795 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:48.716796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:48.716807 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:48.717045 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:48.717087 (+ 42us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.717879 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.719974 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.720672 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.721251 (+ 579us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:48.721265 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:48.721287 (+ 22us) server_negotiation.cc:299] Negotiation successful
0809 03:23:48.721318 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":63,"threads_started":1}
I20260809 03:23:48.721575 16003 tablet_service.cc:1467] Processing CreateTablet for tablet 146d538b4b694674a91094edd2a60a73 (DEFAULT_TABLE table=test-table [id=a968583cc1b240f1bbc8375c76bd0e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:48.721716 16003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 146d538b4b694674a91094edd2a60a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:48.722162 16163 tablet_bootstrap.cc:492] T 146d538b4b694674a91094edd2a60a73 P 73eaa15098d547f5ac2372300461ef7e: Bootstrap starting.
I20260809 03:23:48.722611 16163 tablet_bootstrap.cc:654] T 146d538b4b694674a91094edd2a60a73 P 73eaa15098d547f5ac2372300461ef7e: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:48.722674 16164 tablet_bootstrap.cc:492] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094: Bootstrap starting.
I20260809 03:23:48.723060 16164 tablet_bootstrap.cc:654] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:48.723191 16167 tablet_bootstrap.cc:492] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708: Bootstrap starting.
I20260809 03:23:48.723516 16163 tablet_bootstrap.cc:492] T 146d538b4b694674a91094edd2a60a73 P 73eaa15098d547f5ac2372300461ef7e: No bootstrap required, opened a new log
I20260809 03:23:48.723578 16163 ts_tablet_manager.cc:1397] T 146d538b4b694674a91094edd2a60a73 P 73eaa15098d547f5ac2372300461ef7e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:48.723595 16167 tablet_bootstrap.cc:654] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:48.723748 16163 raft_consensus.cc:348] T 146d538b4b694674a91094edd2a60a73 P 73eaa15098d547f5ac2372300461ef7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } } peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } }
I20260809 03:23:48.723837 16163 raft_consensus.cc:374] T 146d538b4b694674a91094edd2a60a73 P 73eaa15098d547f5ac2372300461ef7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:48.723870 16163 raft_consensus.cc:729] T 146d538b4b694674a91094edd2a60a73 P 73eaa15098d547f5ac2372300461ef7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73eaa15098d547f5ac2372300461ef7e, State: Initialized, Role: FOLLOWER
I20260809 03:23:48.723932 16163 consensus_queue.cc:260] T 146d538b4b694674a91094edd2a60a73 P 73eaa15098d547f5ac2372300461ef7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } } peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } }
I20260809 03:23:48.724100 16163 ts_tablet_manager.cc:1428] T 146d538b4b694674a91094edd2a60a73 P 73eaa15098d547f5ac2372300461ef7e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:48.724256 16167 tablet_bootstrap.cc:492] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708: No bootstrap required, opened a new log
I20260809 03:23:48.724309 16167 ts_tablet_manager.cc:1397] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:48.724376 16164 tablet_bootstrap.cc:492] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094: No bootstrap required, opened a new log
I20260809 03:23:48.724418 16164 ts_tablet_manager.cc:1397] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 03:23:48.724457 16167 raft_consensus.cc:348] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } } peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } }
I20260809 03:23:48.724519 16167 raft_consensus.cc:374] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:48.724539 16167 raft_consensus.cc:729] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd526f4d67ce431499d420aaec9e6708, State: Initialized, Role: FOLLOWER
I20260809 03:23:48.724511 16164 raft_consensus.cc:348] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } } peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } }
I20260809 03:23:48.724575 16164 raft_consensus.cc:374] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:48.724598 16164 raft_consensus.cc:729] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1b9e89fd789450384d19508e2a23094, State: Initialized, Role: FOLLOWER
I20260809 03:23:48.724601 16167 consensus_queue.cc:260] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } } peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } }
I20260809 03:23:48.724654 16164 consensus_queue.cc:260] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } } peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } }
I20260809 03:23:48.724740 16167 ts_tablet_manager.cc:1428] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:48.724802 16164 ts_tablet_manager.cc:1428] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 03:23:48.724889 15785 heartbeater.cc:503] Master 127.8.5.253:38551 was elected leader, sending a full tablet report...
I20260809 03:23:48.725304 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.724984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.194:47743)
0809 03:23:48.725229 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.725266 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":80,"threads_started":1}
I20260809 03:23:48.725679 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.725503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.194:53727)
0809 03:23:48.725615 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.725641 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":72,"threads_started":1}
I20260809 03:23:48.725847 16174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.724923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.195:49323)
0809 03:23:48.725770 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.725805 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":826,"thread_start_us":71,"threads_started":1}
I20260809 03:23:48.725906 16171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.724246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.193:59405)
0809 03:23:48.725104 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.725864 (+ 760us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":837,"thread_start_us":86,"threads_started":1}
I20260809 03:23:48.725945 16073 heartbeater.cc:503] Master 127.8.5.253:38551 was elected leader, sending a full tablet report...
I20260809 03:23:48.726104 15930 heartbeater.cc:503] Master 127.8.5.253:38551 was elected leader, sending a full tablet report...
I20260809 03:23:48.726186 16174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.726032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.195:52743)
0809 03:23:48.726138 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.726162 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":72,"threads_started":1}
I20260809 03:23:48.726286 16171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.726109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.193:53237)
0809 03:23:48.726225 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.726250 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":76,"threads_started":1}
I20260809 03:23:48.778052 16173 raft_consensus.cc:482] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:23:48.778164 16173 raft_consensus.cc:504] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } } peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } }
I20260809 03:23:48.778384 16173 leader_election.cc:288] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd526f4d67ce431499d420aaec9e6708 (127.8.5.195:44749), 73eaa15098d547f5ac2372300461ef7e (127.8.5.193:33243)
I20260809 03:23:48.778573 16024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "146d538b4b694674a91094edd2a60a73" candidate_uuid: "c1b9e89fd789450384d19508e2a23094" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd526f4d67ce431499d420aaec9e6708" is_pre_election: true
I20260809 03:23:48.778584 15734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "146d538b4b694674a91094edd2a60a73" candidate_uuid: "c1b9e89fd789450384d19508e2a23094" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73eaa15098d547f5ac2372300461ef7e" is_pre_election: true
I20260809 03:23:48.778668 16024 raft_consensus.cc:2454] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1b9e89fd789450384d19508e2a23094 in term 0.
I20260809 03:23:48.778692 15734 raft_consensus.cc:2454] T 146d538b4b694674a91094edd2a60a73 P 73eaa15098d547f5ac2372300461ef7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1b9e89fd789450384d19508e2a23094 in term 0.
I20260809 03:23:48.778882 15813 leader_election.cc:302] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73eaa15098d547f5ac2372300461ef7e, c1b9e89fd789450384d19508e2a23094; no voters:
I20260809 03:23:48.779014 16173 raft_consensus.cc:2781] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:23:48.779074 16173 raft_consensus.cc:482] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:23:48.779095 16173 raft_consensus.cc:3037] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:48.779793 16173 raft_consensus.cc:504] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } } peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } }
I20260809 03:23:48.779958 16173 leader_election.cc:288] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [CANDIDATE]: Term 1 election: Requested vote from peers fd526f4d67ce431499d420aaec9e6708 (127.8.5.195:44749), 73eaa15098d547f5ac2372300461ef7e (127.8.5.193:33243)
I20260809 03:23:48.780130 16024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "146d538b4b694674a91094edd2a60a73" candidate_uuid: "c1b9e89fd789450384d19508e2a23094" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd526f4d67ce431499d420aaec9e6708"
I20260809 03:23:48.780128 15734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "146d538b4b694674a91094edd2a60a73" candidate_uuid: "c1b9e89fd789450384d19508e2a23094" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73eaa15098d547f5ac2372300461ef7e"
I20260809 03:23:48.780223 15734 raft_consensus.cc:3037] T 146d538b4b694674a91094edd2a60a73 P 73eaa15098d547f5ac2372300461ef7e [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:48.780223 16024 raft_consensus.cc:3037] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:48.780857 15734 raft_consensus.cc:2454] T 146d538b4b694674a91094edd2a60a73 P 73eaa15098d547f5ac2372300461ef7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1b9e89fd789450384d19508e2a23094 in term 1.
I20260809 03:23:48.780891 16024 raft_consensus.cc:2454] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1b9e89fd789450384d19508e2a23094 in term 1.
I20260809 03:23:48.781031 15813 leader_election.cc:302] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73eaa15098d547f5ac2372300461ef7e, c1b9e89fd789450384d19508e2a23094; no voters:
I20260809 03:23:48.781122 16173 raft_consensus.cc:2781] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:48.781278 16173 raft_consensus.cc:686] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [term 1 LEADER]: Becoming Leader. State: Replica: c1b9e89fd789450384d19508e2a23094, State: Running, Role: LEADER
I20260809 03:23:48.781389 16173 consensus_queue.cc:237] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } } peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } }
I20260809 03:23:48.781639 16176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.781512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.194:58041)
0809 03:23:48.781562 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.781601 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260809 03:23:48.782012 15396 catalog_manager.cc:5495] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1b9e89fd789450384d19508e2a23094 (127.8.5.194). New cstate: current_term: 1 leader_uuid: "c1b9e89fd789450384d19508e2a23094" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1b9e89fd789450384d19508e2a23094" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 40113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 } health_report { overall_health: UNKNOWN } } }
I20260809 03:23:48.794382 16160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.791928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32892 (local address 127.8.5.194:40113)
0809 03:23:48.791990 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:48.791993 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:48.792046 (+ 53us) server_negotiation.cc:407] Connection header received
0809 03:23:48.792118 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:48.792119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:48.792132 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:48.792203 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:48.792358 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.792849 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.793669 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:48.793885 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:48.793973 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:48.794118 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:48.794155 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:48.794217 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:48.794278 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 03:23:48.794302 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 03:23:48.795348 15734 raft_consensus.cc:1261] T 146d538b4b694674a91094edd2a60a73 P 73eaa15098d547f5ac2372300461ef7e [term 1 FOLLOWER]: Refusing update from remote peer c1b9e89fd789450384d19508e2a23094: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:48.795399 16024 raft_consensus.cc:1261] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708 [term 1 FOLLOWER]: Refusing update from remote peer c1b9e89fd789450384d19508e2a23094: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:48.795584 16179 consensus_queue.cc:1035] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73eaa15098d547f5ac2372300461ef7e" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:48.795671 16173 consensus_queue.cc:1035] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd526f4d67ce431499d420aaec9e6708" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:48.796399 16177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.796182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.195:40445)
0809 03:23:48.796296 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.796358 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260809 03:23:48.796990 16178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.796744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.193:40983)
0809 03:23:48.796909 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.796949 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
I20260809 03:23:48.797533 16176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.797403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.194:54459)
0809 03:23:48.797473 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.797506 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 03:23:48.798180 16177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.798086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.195:49265)
0809 03:23:48.798122 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.798147 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260809 03:23:48.798630 16178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.798525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.193:45075)
0809 03:23:48.798572 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.798599 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 03:23:48.798774 16183 mvcc.cc:205] Tried to move back new op lower bound from 7316462914743611392 to 7316462914688942080. Current Snapshot: MvccSnapshot[applied={T|T < 7316462914743611392 or (T in {7316462914743611392})}]
I20260809 03:23:48.798894 16176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.798809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33131 (local address 127.8.5.194:59379)
0809 03:23:48.798842 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.798870 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260809 03:23:48.799610 15398 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44774:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:48.799685 15398 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44774:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:48.800952 15398 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c6fc776a10204ce79d77d9a2513cf23e: Sending DeleteTablet for 3 replicas of tablet 146d538b4b694674a91094edd2a60a73
I20260809 03:23:48.801260 16003 tablet_service.cc:1514] Processing DeleteTablet for tablet 146d538b4b694674a91094edd2a60a73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:48 UTC) from {username='oryx', principal='oryx/127.8.5.253@KRBTEST.COM'} at 127.0.0.1:40524
I20260809 03:23:48.801342 15714 tablet_service.cc:1514] Processing DeleteTablet for tablet 146d538b4b694674a91094edd2a60a73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:48 UTC) from {username='oryx', principal='oryx/127.8.5.253@KRBTEST.COM'} at 127.0.0.1:60440
I20260809 03:23:48.801410 15859 tablet_service.cc:1514] Processing DeleteTablet for tablet 146d538b4b694674a91094edd2a60a73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:48 UTC) from {username='oryx', principal='oryx/127.8.5.253@KRBTEST.COM'} at 127.0.0.1:32886
I20260809 03:23:48.801539 16191 tablet_replica.cc:330] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708: stopping tablet replica
I20260809 03:23:48.801614 16191 raft_consensus.cc:2229] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:48.801641 16193 tablet_replica.cc:330] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094: stopping tablet replica
I20260809 03:23:48.801666 16191 raft_consensus.cc:2258] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:48.801710 16193 raft_consensus.cc:2229] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:23:48.801721 16192 tablet_replica.cc:330] T 146d538b4b694674a91094edd2a60a73 P 73eaa15098d547f5ac2372300461ef7e: stopping tablet replica
I20260809 03:23:48.801776 16193 raft_consensus.cc:2258] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:48.801764 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 15556
I20260809 03:23:48.801783 16192 raft_consensus.cc:2229] T 146d538b4b694674a91094edd2a60a73 P 73eaa15098d547f5ac2372300461ef7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:48.801832 16192 raft_consensus.cc:2258] T 146d538b4b694674a91094edd2a60a73 P 73eaa15098d547f5ac2372300461ef7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:48.802121 16193 ts_tablet_manager.cc:1905] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:48.802919 16191 ts_tablet_manager.cc:1905] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:48.803933 16193 ts_tablet_manager.cc:1918] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:23:48.804004 16193 log.cc:1196] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/146d538b4b694674a91094edd2a60a73
I20260809 03:23:48.804409 16193 ts_tablet_manager.cc:1939] T 146d538b4b694674a91094edd2a60a73 P c1b9e89fd789450384d19508e2a23094: Deleting consensus metadata
I20260809 03:23:48.804787 16191 ts_tablet_manager.cc:1918] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:23:48.804884 15382 catalog_manager.cc:4841] TS c1b9e89fd789450384d19508e2a23094 (127.8.5.194:40113): tablet 146d538b4b694674a91094edd2a60a73 (table test-table [id=a968583cc1b240f1bbc8375c76bd0e80]) successfully deleted
I20260809 03:23:48.805135 16191 log.cc:1196] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/146d538b4b694674a91094edd2a60a73
I20260809 03:23:48.805418 16191 ts_tablet_manager.cc:1939] T 146d538b4b694674a91094edd2a60a73 P fd526f4d67ce431499d420aaec9e6708: Deleting consensus metadata
I20260809 03:23:48.805743 15381 catalog_manager.cc:4841] TS fd526f4d67ce431499d420aaec9e6708 (127.8.5.195:44749): tablet 146d538b4b694674a91094edd2a60a73 (table test-table [id=a968583cc1b240f1bbc8375c76bd0e80]) successfully deleted
I20260809 03:23:48.810658 16159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:48.810553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:33243 (local address 127.0.0.1:60450)
0809 03:23:48.810607 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:48.810631 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.193:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 03:23:48.810765 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 15792
W20260809 03:23:48.810845 15384 catalog_manager.cc:4584] TS 73eaa15098d547f5ac2372300461ef7e (127.8.5.193:33243): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 146d538b4b694674a91094edd2a60a73: Network error: Client connection negotiation failed: client connection to 127.8.5.193:33243: connect: Connection refused (error 111)
I20260809 03:23:48.818382 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 15936
I20260809 03:23:48.823824 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 15256
I20260809 03:23:48.829687 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 15457
2026-08-09T03:23:48Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (4715 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:23:48 dist-test-slave-2w3w krb5kdc[16196](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:23:48 dist-test-slave-2w3w krb5kdc[16196](info): set up 2 sockets
Aug 09 03:23:48 dist-test-slave-2w3w krb5kdc[16196](info): commencing operation
krb5kdc: starting...
W20260809 03:23:49.912679 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:23:49 dist-test-slave-2w3w krb5kdc[16196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:23:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:49Z Disabled control of system clock
WARNING: no policy specified for oryx/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.254.keytab.
Entry for principal oryx/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.254.keytab.
I20260809 03:23:50.034049 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:33435
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.254.keytab
--principal=oryx/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:36481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:33435
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:50.115486 16209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:50.115729 16209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:50.115779 16209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:50.116930 16209 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:50.116995 16209 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 03:23:50.117018 16209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:50.117040 16209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:50.117070 16209 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:50.117094 16209 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:23:50.118602 16209 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:36481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:33435
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.254.keytab
--principal=oryx/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:33435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16209
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:50.118886 16209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:50.119134 16209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:50.123802 16215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:50.123814 16217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:50.123814 16214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:50.124099 16209 server_base.cc:1034] running on GCE node
I20260809 03:23:50.124308 16209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:50.124567 16209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:50.125739 16209 hybrid_clock.cc:648] HybridClock initialized: now 1786245830125718 us; error 35 us; skew 500 ppm
Aug 09 03:23:50 dist-test-slave-2w3w krb5kdc[16196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245830, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:50.128492 16209 init.cc:377] Logged in from keytab as oryx/127.8.5.254@KRBTEST.COM (short username oryx)
I20260809 03:23:50.128933 16209 webserver.cc:460] Webserver started at http://127.8.5.254:35927/ using document root <none> and password file <none>
I20260809 03:23:50.129112 16209 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:50.129150 16209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:50.129236 16209 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:50.130225 16209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "68e3b36849694b80865873cab64a81a1"
format_stamp: "Formatted at 2026-08-09 03:23:50 on dist-test-slave-2w3w"
server_key: "75b810db13f1ac4d12b8c48b6c7f4e50"
server_key_iv: "bed8604469c2cf7c3d808caec20d10c0"
server_key_version: "encryptionkey@0"
I20260809 03:23:50.130527 16209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "68e3b36849694b80865873cab64a81a1"
format_stamp: "Formatted at 2026-08-09 03:23:50 on dist-test-slave-2w3w"
server_key: "75b810db13f1ac4d12b8c48b6c7f4e50"
server_key_iv: "bed8604469c2cf7c3d808caec20d10c0"
server_key_version: "encryptionkey@0"
I20260809 03:23:50.131906 16209 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:23:50.132612 16224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:50.132858 16209 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:23:50.132938 16209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "68e3b36849694b80865873cab64a81a1"
format_stamp: "Formatted at 2026-08-09 03:23:50 on dist-test-slave-2w3w"
server_key: "75b810db13f1ac4d12b8c48b6c7f4e50"
server_key_iv: "bed8604469c2cf7c3d808caec20d10c0"
server_key_version: "encryptionkey@0"
I20260809 03:23:50.132992 16209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:50.141104 16209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:50.142925 16209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:50.143085 16209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:50.147842 16209 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:33435
I20260809 03:23:50.147889 16291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:33435 every 8 connection(s)
I20260809 03:23:50.148203 16209 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:50.148847 16292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:50.149101 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 16209
I20260809 03:23:50.149201 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:23:50.149410 8215 external_mini_cluster.cc:1428] Setting key 5f923af139db86673892eea14655647a
I20260809 03:23:50.151925 16292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1: Bootstrap starting.
I20260809 03:23:50.152647 16292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:50.152944 16292 log.cc:824] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:50.153636 16292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1: No bootstrap required, opened a new log
I20260809 03:23:50.155752 16292 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e3b36849694b80865873cab64a81a1" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33435 } }
I20260809 03:23:50.155916 16292 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:50.155967 16292 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e3b36849694b80865873cab64a81a1, State: Initialized, Role: FOLLOWER
I20260809 03:23:50.156090 16292 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e3b36849694b80865873cab64a81a1" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33435 } }
I20260809 03:23:50.156169 16292 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:50.156214 16292 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:50.156262 16292 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1 [term 0 FOLLOWER]: Advancing to term 1
Aug 09 03:23:50 dist-test-slave-2w3w krb5kdc[16196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM
I20260809 03:23:50.156841 16292 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e3b36849694b80865873cab64a81a1" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33435 } }
I20260809 03:23:50.156949 16292 leader_election.cc:302] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68e3b36849694b80865873cab64a81a1; no voters:
I20260809 03:23:50.157114 16292 leader_election.cc:288] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:23:50.157179 16297 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:50.157372 16292 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:50.157385 16297 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1 [term 1 LEADER]: Becoming Leader. State: Replica: 68e3b36849694b80865873cab64a81a1, State: Running, Role: LEADER
I20260809 03:23:50.157614 16297 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e3b36849694b80865873cab64a81a1" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33435 } }
I20260809 03:23:50.158066 16299 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68e3b36849694b80865873cab64a81a1. Latest consensus state: current_term: 1 leader_uuid: "68e3b36849694b80865873cab64a81a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e3b36849694b80865873cab64a81a1" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33435 } } }
I20260809 03:23:50.158048 16298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68e3b36849694b80865873cab64a81a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e3b36849694b80865873cab64a81a1" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33435 } } }
I20260809 03:23:50.158187 16299 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:50.158200 16298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:50.158412 16306 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:50.159031 16306 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:50.160661 16306 catalog_manager.cc:1347] Generated new cluster ID: 1decb27c38e24ac899d78c69d83d3ddf
I20260809 03:23:50.160712 16306 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:23:50.161064 16295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.149969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53964 (local address 127.8.5.254:33435)
0809 03:23:50.150163 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:50.150173 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:50.150209 (+ 36us) server_negotiation.cc:407] Connection header received
0809 03:23:50.150719 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:50.150727 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:50.150788 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:50.150934 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:50.151597 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.152975 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.153804 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.154211 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.154335 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.156863 (+ 2528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:50.156868 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:50.156868 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:50.156879 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:50.159006 (+ 2127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:50.159431 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:50.159434 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:50.159434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:50.159535 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:50.159730 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:50.159731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:50.159731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:50.160045 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:50.160188 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:50.160720 (+ 532us) server_negotiation.cc:299] Negotiation successful
0809 03:23:50.160874 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":90,"threads_started":1}
I20260809 03:23:50.168390 16306 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:23:50.168902 16306 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:50.172848 16306 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1: Generated new TSK 0
I20260809 03:23:50.173012 16306 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.193.keytab.
Entry for principal oryx/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.193.keytab.
I20260809 03:23:50.199977 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33435
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.193.keytab
--principal=oryx/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:36481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:50.280927 16318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:50.281116 16318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:50.281139 16318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:50.282212 16318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:50.282248 16318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:50.282269 16318 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 03:23:50.282285 16318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:23:50.283756 16318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:36481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.193.keytab
--principal=oryx/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.5.254:33435
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:50.283931 16318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:50.284097 16318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:50.288853 16325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:50.288849 16327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:50.288872 16324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:50.289085 16318 server_base.cc:1034] running on GCE node
I20260809 03:23:50.289270 16318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:50.289510 16318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:50.290652 16318 hybrid_clock.cc:648] HybridClock initialized: now 1786245830290643 us; error 36 us; skew 500 ppm
Aug 09 03:23:50 dist-test-slave-2w3w krb5kdc[16196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245830, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:50.293059 16318 init.cc:377] Logged in from keytab as oryx/127.8.5.193@KRBTEST.COM (short username oryx)
I20260809 03:23:50.293460 16318 webserver.cc:460] Webserver started at http://127.8.5.193:35909/ using document root <none> and password file <none>
I20260809 03:23:50.293690 16318 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:50.293754 16318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:50.293902 16318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:50.294906 16318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "6a2e9c54bded4533bb8af6cbd022b864"
format_stamp: "Formatted at 2026-08-09 03:23:50 on dist-test-slave-2w3w"
server_key: "acbee86dc4e08a4f9262ecab239ab900"
server_key_iv: "ebc0ee1a24ea2bf6755ece8aa1f851f1"
server_key_version: "encryptionkey@0"
I20260809 03:23:50.295364 16318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "6a2e9c54bded4533bb8af6cbd022b864"
format_stamp: "Formatted at 2026-08-09 03:23:50 on dist-test-slave-2w3w"
server_key: "acbee86dc4e08a4f9262ecab239ab900"
server_key_iv: "ebc0ee1a24ea2bf6755ece8aa1f851f1"
server_key_version: "encryptionkey@0"
I20260809 03:23:50.296633 16318 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:50.297307 16335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:50.297473 16318 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:50.297559 16318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "6a2e9c54bded4533bb8af6cbd022b864"
format_stamp: "Formatted at 2026-08-09 03:23:50 on dist-test-slave-2w3w"
server_key: "acbee86dc4e08a4f9262ecab239ab900"
server_key_iv: "ebc0ee1a24ea2bf6755ece8aa1f851f1"
server_key_version: "encryptionkey@0"
I20260809 03:23:50.297636 16318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:50.309610 16318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:50.311367 16318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:50.311512 16318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:50.311986 16318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:50.312049 16318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:50.312103 16318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:50.312134 16318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 03:23:50 dist-test-slave-2w3w krb5kdc[16196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245830, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM
I20260809 03:23:50.318905 16318 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:45763
I20260809 03:23:50.318984 16454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:45763 every 8 connection(s)
I20260809 03:23:50.319316 16318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:23:50.322265 16295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.312459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:51923 (local address 127.8.5.254:33435)
0809 03:23:50.312518 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:50.312520 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:50.312703 (+ 183us) server_negotiation.cc:407] Connection header received
0809 03:23:50.313213 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:50.313215 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:50.313227 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:50.313291 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:50.314117 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.314989 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.316528 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.316902 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.316983 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.319334 (+ 2351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:50.319336 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:50.319336 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:50.319345 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:50.321218 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:50.321567 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:50.321567 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:50.321568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:50.321619 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:50.321782 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:50.321783 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:50.321783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:50.321881 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:50.321930 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:50.322142 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 03:23:50.322204 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 03:23:50.322468 16344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.312449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33435 (local address 127.8.5.193:51923)
0809 03:23:50.312596 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:50.312630 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:50.313113 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:50.313363 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:50.313366 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:50.313717 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:50.313998 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.314006 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.315081 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.315081 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.316439 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.316442 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.316988 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.316989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.317091 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.317620 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:50.317630 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:50.319236 (+ 1606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:50.321287 (+ 2051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:50.321294 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:50.321295 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:50.321505 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:50.321658 (+ 153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:50.321658 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:50.321659 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:50.321738 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:50.321935 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:50.321940 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:50.322048 (+ 108us) client_negotiation.cc:769] Sending connection context
0809 03:23:50.322126 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 03:23:50.322239 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":76,"threads_started":1}
I20260809 03:23:50.322986 16455 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33435
I20260809 03:23:50.323087 16455 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:50.323256 16455 heartbeater.cc:511] Master 127.8.5.254:33435 requested a full tablet report, sending...
I20260809 03:23:50.323794 16243 ts_manager.cc:194] Registered new tserver with Master: 6a2e9c54bded4533bb8af6cbd022b864 (127.8.5.193:45763)
I20260809 03:23:50.324565 16243 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:51923
I20260809 03:23:50.325093 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 16318
I20260809 03:23:50.325203 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:23:50.325410 8215 external_mini_cluster.cc:1428] Setting key 8694c247eecaa065b848c68109b0932a
I20260809 03:23:50.329597 16295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.324046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:54877 (local address 127.8.5.254:33435)
0809 03:23:50.324077 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:50.324079 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:50.324211 (+ 132us) server_negotiation.cc:407] Connection header received
0809 03:23:50.324282 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:50.324283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:50.324293 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:50.324336 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:50.324708 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.325239 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.326037 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.326331 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.326408 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.327253 (+ 845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:50.327254 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:50.327254 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:50.327262 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:50.328612 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:50.328992 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:50.328993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:50.328993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:50.329039 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:50.329224 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:50.329224 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:50.329225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:50.329303 (+ 78us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:50.329346 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:50.329489 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 03:23:50.329544 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13}
I20260809 03:23:50.329735 16462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.323982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33435 (local address 127.8.5.193:54877)
0809 03:23:50.324149 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:50.324157 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:50.324225 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:50.324349 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:50.324350 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:50.324551 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:50.324597 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.324598 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.325351 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.325352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.325981 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.325984 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.326405 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.326406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.326457 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.326858 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:50.326862 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:50.327176 (+ 314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:50.328688 (+ 1512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:50.328689 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:50.328689 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:50.328924 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:50.329099 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:50.329100 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:50.329100 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:50.329166 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:50.329355 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:50.329356 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:50.329399 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 03:23:50.329476 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 03:23:50.329584 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":71,"threads_started":1}
WARNING: no policy specified for oryx/127.8.5.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.194.keytab.
Entry for principal oryx/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.194.keytab.
I20260809 03:23:50.351517 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33435
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.194.keytab
--principal=oryx/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:36481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:50.431808 16466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:50.432008 16466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:50.432031 16466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:50.433171 16466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:50.433213 16466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:50.433233 16466 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 03:23:50.433250 16466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:23:50.434764 16466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:36481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.194.keytab
--principal=oryx/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.5.254:33435
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:50.435022 16466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:50.435257 16466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:50.440209 16473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:50.440209 16474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:50.440246 16476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:50.440491 16466 server_base.cc:1034] running on GCE node
I20260809 03:23:50.440694 16466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:50.440936 16466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:50.442073 16466 hybrid_clock.cc:648] HybridClock initialized: now 1786245830442057 us; error 35 us; skew 500 ppm
Aug 09 03:23:50 dist-test-slave-2w3w krb5kdc[16196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245830, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:50.444546 16466 init.cc:377] Logged in from keytab as oryx/127.8.5.194@KRBTEST.COM (short username oryx)
I20260809 03:23:50.445006 16466 webserver.cc:460] Webserver started at http://127.8.5.194:39269/ using document root <none> and password file <none>
I20260809 03:23:50.445214 16466 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:50.445258 16466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:50.445418 16466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:50.446426 16466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0"
format_stamp: "Formatted at 2026-08-09 03:23:50 on dist-test-slave-2w3w"
server_key: "c522d7df31c896823027bd1041d0002e"
server_key_iv: "7678659628b00cf5fefc3cd0bfccf6b9"
server_key_version: "encryptionkey@0"
I20260809 03:23:50.446780 16466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0"
format_stamp: "Formatted at 2026-08-09 03:23:50 on dist-test-slave-2w3w"
server_key: "c522d7df31c896823027bd1041d0002e"
server_key_iv: "7678659628b00cf5fefc3cd0bfccf6b9"
server_key_version: "encryptionkey@0"
I20260809 03:23:50.448064 16466 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:23:50.448738 16483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:50.449060 16466 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:50.449157 16466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0"
format_stamp: "Formatted at 2026-08-09 03:23:50 on dist-test-slave-2w3w"
server_key: "c522d7df31c896823027bd1041d0002e"
server_key_iv: "7678659628b00cf5fefc3cd0bfccf6b9"
server_key_version: "encryptionkey@0"
I20260809 03:23:50.449234 16466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:50.459486 16466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:50.461627 16466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:50.461777 16466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:50.462296 16466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:50.462352 16466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:50.462392 16466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:50.462419 16466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 03:23:50 dist-test-slave-2w3w krb5kdc[16196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245830, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM
I20260809 03:23:50.469647 16466 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:37515
I20260809 03:23:50.469705 16606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:37515 every 8 connection(s)
I20260809 03:23:50.470037 16466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:23:50.472047 16295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.462628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:49637 (local address 127.8.5.254:33435)
0809 03:23:50.462694 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:50.462696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:50.462929 (+ 233us) server_negotiation.cc:407] Connection header received
0809 03:23:50.463478 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:50.463480 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:50.463493 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:50.463580 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:50.464175 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.465022 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.466081 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.466292 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.466369 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.469463 (+ 3094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:50.469465 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:50.469466 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:50.469474 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:50.471012 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:50.471363 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:50.471364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:50.471364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:50.471415 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:50.471578 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:50.471578 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:50.471579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:50.471673 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:50.471720 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:50.471927 (+ 207us) server_negotiation.cc:299] Negotiation successful
0809 03:23:50.471986 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 03:23:50.472319 16492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.462633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33435 (local address 127.8.5.194:49637)
0809 03:23:50.462801 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:50.462838 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:50.463377 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:50.463627 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:50.463629 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:50.463847 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:50.464091 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.464097 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.465116 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.465117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.465966 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.465985 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.466378 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.466380 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.466511 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.467053 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:50.467064 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:50.469367 (+ 2303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:50.471088 (+ 1721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:50.471092 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:50.471094 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:50.471295 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:50.471454 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:50.471455 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:50.471455 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:50.471534 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:50.471723 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:50.471728 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:50.471826 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 03:23:50.471905 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 03:23:50.472014 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":98,"threads_started":1}
I20260809 03:23:50.472770 16607 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33435
I20260809 03:23:50.472852 16607 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:50.473018 16607 heartbeater.cc:511] Master 127.8.5.254:33435 requested a full tablet report, sending...
I20260809 03:23:50.473650 16244 ts_manager.cc:194] Registered new tserver with Master: 5ec1f54bfdf64171a3f8768eeb10e2a0 (127.8.5.194:37515)
I20260809 03:23:50.474191 16244 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:49637
I20260809 03:23:50.476311 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 16466
I20260809 03:23:50.476437 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:23:50.476647 8215 external_mini_cluster.cc:1428] Setting key ef08fdf51be2bca81a0d973a6bfa2a04
I20260809 03:23:50.479101 16295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.473728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:54561 (local address 127.8.5.254:33435)
0809 03:23:50.473770 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:50.473771 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:50.473947 (+ 176us) server_negotiation.cc:407] Connection header received
0809 03:23:50.473987 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:50.473987 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:50.473998 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:50.474046 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:50.474369 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.474873 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.475590 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.475763 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.475819 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.476707 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:50.476708 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:50.476709 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:50.476716 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:50.478003 (+ 1287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:50.478378 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:50.478379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:50.478379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:50.478423 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:50.478593 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:50.478594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:50.478594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:50.478702 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:50.478746 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:50.478906 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 03:23:50.478992 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 03:23:50.479168 16616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.473677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33435 (local address 127.8.5.194:54561)
0809 03:23:50.473863 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:50.473872 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:50.473937 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:50.474055 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:50.474056 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:50.474194 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:50.474244 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.474245 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.475006 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.475006 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.475524 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.475526 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.475828 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.475829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.475874 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.476225 (+ 351us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:50.476231 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:50.476617 (+ 386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:50.478074 (+ 1457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:50.478074 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:50.478075 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:50.478300 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:50.478476 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:50.478477 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:50.478477 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:50.478541 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:50.478755 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:50.478756 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:50.478797 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 03:23:50.478892 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 03:23:50.479023 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":122,"threads_started":1}
WARNING: no policy specified for oryx/127.8.5.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.195.keytab.
Entry for principal oryx/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.195.keytab.
I20260809 03:23:50.502243 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33435
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.195.keytab
--principal=oryx/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:36481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:50.582371 16624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:50.582599 16624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:50.582638 16624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:50.583796 16624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:50.583870 16624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:50.583909 16624 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 03:23:50.583959 16624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:23:50.585435 16624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:36481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.195.keytab
--principal=oryx/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.5.254:33435
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:50.585688 16624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:50.585907 16624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:50.590886 16634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:50.590878 16631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:50.590936 16632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:50.591145 16624 server_base.cc:1034] running on GCE node
I20260809 03:23:50.591337 16624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:50.591534 16624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:50.592703 16624 hybrid_clock.cc:648] HybridClock initialized: now 1786245830592695 us; error 35 us; skew 500 ppm
Aug 09 03:23:50 dist-test-slave-2w3w krb5kdc[16196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245830, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:50.595209 16624 init.cc:377] Logged in from keytab as oryx/127.8.5.195@KRBTEST.COM (short username oryx)
I20260809 03:23:50.595623 16624 webserver.cc:460] Webserver started at http://127.8.5.195:34859/ using document root <none> and password file <none>
I20260809 03:23:50.595860 16624 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:50.595924 16624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:50.596069 16624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:50.597137 16624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "551da98dbbeb4910a3869e5062a84e73"
format_stamp: "Formatted at 2026-08-09 03:23:50 on dist-test-slave-2w3w"
server_key: "5cbf0f15667b6da14eda70d8a0269e5e"
server_key_iv: "3c10735f4e37ad57e9884732031e9daa"
server_key_version: "encryptionkey@0"
I20260809 03:23:50.597498 16624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "551da98dbbeb4910a3869e5062a84e73"
format_stamp: "Formatted at 2026-08-09 03:23:50 on dist-test-slave-2w3w"
server_key: "5cbf0f15667b6da14eda70d8a0269e5e"
server_key_iv: "3c10735f4e37ad57e9884732031e9daa"
server_key_version: "encryptionkey@0"
I20260809 03:23:50.598866 16624 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:23:50.599611 16642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:50.599808 16624 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:23:50.599900 16624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "551da98dbbeb4910a3869e5062a84e73"
format_stamp: "Formatted at 2026-08-09 03:23:50 on dist-test-slave-2w3w"
server_key: "5cbf0f15667b6da14eda70d8a0269e5e"
server_key_iv: "3c10735f4e37ad57e9884732031e9daa"
server_key_version: "encryptionkey@0"
I20260809 03:23:50.599972 16624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:50.609789 16624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:50.612071 16624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:50.612232 16624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:50.612735 16624 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:50.612804 16624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:50.612846 16624 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:50.612871 16624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 03:23:50 dist-test-slave-2w3w krb5kdc[16196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245830, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM
I20260809 03:23:50.620035 16624 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:35507
I20260809 03:23:50.620115 16765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:35507 every 8 connection(s)
I20260809 03:23:50.620451 16624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:23:50.623325 16295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.613249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:56327 (local address 127.8.5.254:33435)
0809 03:23:50.613328 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:50.613330 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:50.613490 (+ 160us) server_negotiation.cc:407] Connection header received
0809 03:23:50.613995 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:50.613997 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:50.614012 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:50.614092 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:50.614947 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.615834 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.616913 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.617265 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.617357 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.620119 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:50.620121 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:50.620121 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:50.620129 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:50.621662 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:50.622093 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:50.622095 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:50.622096 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:50.622159 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:50.622544 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:50.622546 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:50.622546 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:50.622678 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:50.622751 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:50.623112 (+ 361us) server_negotiation.cc:299] Negotiation successful
0809 03:23:50.623221 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 03:23:50.623461 16651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.613209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33435 (local address 127.8.5.195:56327)
0809 03:23:50.613362 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:50.613402 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:50.613906 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:50.614180 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:50.614184 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:50.614546 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:50.614836 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.614843 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.615934 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.615935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.616778 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.616781 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.617365 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.617366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.617544 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.618096 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:50.618106 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:50.620013 (+ 1907us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:50.621770 (+ 1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:50.621776 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:50.621779 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:50.621999 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:50.622222 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:50.622223 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:50.622223 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:50.622450 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:50.622791 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:50.622798 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:50.622927 (+ 129us) client_negotiation.cc:769] Sending connection context
0809 03:23:50.623083 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 03:23:50.623242 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":76,"threads_started":1}
I20260809 03:23:50.623929 16766 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33435
I20260809 03:23:50.624008 16766 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:50.624195 16766 heartbeater.cc:511] Master 127.8.5.254:33435 requested a full tablet report, sending...
I20260809 03:23:50.624562 16244 ts_manager.cc:194] Registered new tserver with Master: 551da98dbbeb4910a3869e5062a84e73 (127.8.5.195:35507)
I20260809 03:23:50.625083 16244 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:56327
I20260809 03:23:50.627099 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 16624
I20260809 03:23:50.627225 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:23:50.627394 8215 external_mini_cluster.cc:1428] Setting key 7695253f4c51478b64f05af28a0cb474
I20260809 03:23:50.628258 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:23:50.630456 16295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.624942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:57563 (local address 127.8.5.254:33435)
0809 03:23:50.624981 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:50.624983 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:50.625054 (+ 71us) server_negotiation.cc:407] Connection header received
0809 03:23:50.625115 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:50.625116 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:50.625123 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:50.625181 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:50.625613 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.626073 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.626776 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.627101 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.627169 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.628149 (+ 980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:50.628150 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:50.628150 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:50.628157 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:50.629383 (+ 1226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:50.629712 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:50.629713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:50.629714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:50.629768 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:50.629970 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:50.629971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:50.629972 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:50.630076 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:50.630146 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:50.630293 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 03:23:50.630367 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:23:50.630476 16772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.624865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33435 (local address 127.8.5.195:57563)
0809 03:23:50.624991 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:50.625002 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:50.625062 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:50.625266 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:50.625267 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:50.625466 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:50.625537 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.625538 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.626163 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.626164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.626675 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.626677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.627183 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.627185 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.627259 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.627680 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:50.627685 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:50.628072 (+ 387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:50.629461 (+ 1389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:50.629463 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:50.629463 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:50.629632 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:50.629834 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:50.629835 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:50.629835 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:50.629894 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:50.630138 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:50.630139 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:50.630183 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 03:23:50.630266 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 03:23:50.630368 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":77,"threads_started":1}
Aug 09 03:23:50 dist-test-slave-2w3w krb5kdc[16196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245830, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 03:23:50 dist-test-slave-2w3w krb5kdc[16196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:50 dist-test-slave-2w3w krb5kdc[16196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 03:23:50.650444 16295 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:50.645227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53976 (local address 127.8.5.254:33435)
0809 03:23:50.645310 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:50.645313 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:50.645327 (+ 14us) server_negotiation.cc:407] Connection header received
0809 03:23:50.645350 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:50.645351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:50.645359 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:50.645415 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:50.645950 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.646432 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.647225 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.647419 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.647475 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.650335 (+ 2860us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53976: BlockingRecv error: recv got EOF from 127.0.0.1:53976 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 03:23:50 dist-test-slave-2w3w krb5kdc[16196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245830, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM
I20260809 03:23:50.657517 16295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.651303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53980 (local address 127.8.5.254:33435)
0809 03:23:50.651368 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:50.651370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:50.651448 (+ 78us) server_negotiation.cc:407] Connection header received
0809 03:23:50.651485 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:50.651485 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:50.651493 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:50.651540 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:50.651993 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.652437 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.653113 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.653287 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.653340 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.655323 (+ 1983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:50.655324 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:50.655324 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:50.655330 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:50.656472 (+ 1142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:50.656788 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:50.656789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:50.656789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:50.656867 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:50.657107 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:50.657108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:50.657108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:50.657202 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:50.657271 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:50.657355 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 03:23:50.657451 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 03:23:50.659449 16244 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53980:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:23:50.661176 16244 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:23:50.668385 16790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.663338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:35507 (local address 127.0.0.1:39338)
0809 03:23:50.663646 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:50.663659 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:50.663721 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:50.664227 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:50.664228 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:50.664230 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:50.664272 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.664274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.665543 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.665544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.666893 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.666896 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.667832 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.667833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.668003 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.668027 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 03:23:50.668155 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 03:23:50.668253 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":98,"thread_start_us":54,"threads_started":1}
I20260809 03:23:50.668991 16788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.663338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:45763 (local address 127.0.0.1:34498)
0809 03:23:50.663507 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:50.663546 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:50.663606 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:50.664061 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:50.664066 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:50.664068 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:50.664131 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.664134 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.665509 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.665510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.666894 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.666896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.668738 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.668739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.668810 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.668815 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 03:23:50.668877 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 03:23:50.668918 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":5,"thread_start_us":65,"threads_started":1}
I20260809 03:23:50.669042 16789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.663463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34498 (local address 127.8.5.193:45763)
0809 03:23:50.663846 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:50.663850 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:50.663860 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:23:50.663901 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:50.663903 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:50.663915 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:50.664015 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:50.664227 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.665418 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.667914 (+ 2496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.668657 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.668738 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.668811 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:50.668891 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 03:23:50.668930 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":93,"threads_started":1}
I20260809 03:23:50.669152 16787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.663548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:37515 (local address 127.0.0.1:57756)
0809 03:23:50.665560 (+ 2012us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:50.665570 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:50.665640 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:50.665811 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:50.665812 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:50.665813 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:50.665866 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.665868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.666774 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.666775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.667913 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.667916 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.668902 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.668903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.668963 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.668967 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:23:50.669022 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 03:23:50.669068 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1999,"thread_start_us":40,"threads_started":1}
I20260809 03:23:50.669414 16792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.663663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39338 (local address 127.8.5.195:35507)
0809 03:23:50.664038 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:50.664042 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:50.664054 (+ 12us) server_negotiation.cc:407] Connection header received
0809 03:23:50.664095 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:50.664097 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:50.664114 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:50.664350 (+ 236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:50.664405 (+ 55us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.665460 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.666998 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.667733 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.667805 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.667878 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:50.668915 (+ 1037us) server_negotiation.cc:299] Negotiation successful
0809 03:23:50.668956 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":145,"threads_started":1}
I20260809 03:23:50.669467 16791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.663664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57756 (local address 127.8.5.194:37515)
0809 03:23:50.663889 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:50.663893 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:50.665636 (+ 1743us) server_negotiation.cc:407] Connection header received
0809 03:23:50.665710 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:50.665712 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:50.665726 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:50.665815 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:50.665928 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.666690 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.668015 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.668691 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.668789 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.668861 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:50.669326 (+ 465us) server_negotiation.cc:299] Negotiation successful
0809 03:23:50.669370 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":90,"threads_started":1}
I20260809 03:23:50.669682 16387 tablet_service.cc:1467] Processing CreateTablet for tablet 42f1068c379f45fcb05c29bd1f08ef41 (DEFAULT_TABLE table=test-table [id=5215796ea9004da9b34aab88727965cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:50.670050 16387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42f1068c379f45fcb05c29bd1f08ef41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:50.670032 16694 tablet_service.cc:1467] Processing CreateTablet for tablet 42f1068c379f45fcb05c29bd1f08ef41 (DEFAULT_TABLE table=test-table [id=5215796ea9004da9b34aab88727965cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:50.670154 16536 tablet_service.cc:1467] Processing CreateTablet for tablet 42f1068c379f45fcb05c29bd1f08ef41 (DEFAULT_TABLE table=test-table [id=5215796ea9004da9b34aab88727965cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:50.670408 16694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42f1068c379f45fcb05c29bd1f08ef41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:50.670464 16536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42f1068c379f45fcb05c29bd1f08ef41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:50.673445 16793 tablet_bootstrap.cc:492] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73: Bootstrap starting.
I20260809 03:23:50.674117 16793 tablet_bootstrap.cc:654] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:50.674420 16793 log.cc:824] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:50.674595 16794 tablet_bootstrap.cc:492] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864: Bootstrap starting.
I20260809 03:23:50.674696 16795 tablet_bootstrap.cc:492] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0: Bootstrap starting.
I20260809 03:23:50.675279 16795 tablet_bootstrap.cc:654] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:50.675279 16794 tablet_bootstrap.cc:654] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:50.675614 16794 log.cc:824] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:50.675614 16795 log.cc:824] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:50.675768 16793 tablet_bootstrap.cc:492] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73: No bootstrap required, opened a new log
I20260809 03:23:50.675846 16793 ts_tablet_manager.cc:1397] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:23:50.676499 16795 tablet_bootstrap.cc:492] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0: No bootstrap required, opened a new log
I20260809 03:23:50.676571 16795 ts_tablet_manager.cc:1397] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 03:23:50.676738 16794 tablet_bootstrap.cc:492] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864: No bootstrap required, opened a new log
I20260809 03:23:50.676803 16794 ts_tablet_manager.cc:1397] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 03:23:50.677568 16793 raft_consensus.cc:348] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } }
I20260809 03:23:50.677719 16793 raft_consensus.cc:374] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:50.677763 16793 raft_consensus.cc:729] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 551da98dbbeb4910a3869e5062a84e73, State: Initialized, Role: FOLLOWER
I20260809 03:23:50.677875 16793 consensus_queue.cc:260] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } }
I20260809 03:23:50.678261 16793 ts_tablet_manager.cc:1428] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 03:23:50.678268 16766 heartbeater.cc:503] Master 127.8.5.254:33435 was elected leader, sending a full tablet report...
I20260809 03:23:50.678602 16795 raft_consensus.cc:348] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } }
I20260809 03:23:50.678778 16795 raft_consensus.cc:374] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:50.678822 16795 raft_consensus.cc:729] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec1f54bfdf64171a3f8768eeb10e2a0, State: Initialized, Role: FOLLOWER
I20260809 03:23:50.678736 16794 raft_consensus.cc:348] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } }
I20260809 03:23:50.678884 16794 raft_consensus.cc:374] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:50.678927 16794 raft_consensus.cc:729] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2e9c54bded4533bb8af6cbd022b864, State: Initialized, Role: FOLLOWER
I20260809 03:23:50.678928 16795 consensus_queue.cc:260] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } }
I20260809 03:23:50.679061 16794 consensus_queue.cc:260] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } }
I20260809 03:23:50.679266 16795 ts_tablet_manager.cc:1428] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260809 03:23:50.679324 16794 ts_tablet_manager.cc:1428] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260809 03:23:50.679368 16455 heartbeater.cc:503] Master 127.8.5.254:33435 was elected leader, sending a full tablet report...
I20260809 03:23:50.679389 16607 heartbeater.cc:503] Master 127.8.5.254:33435 was elected leader, sending a full tablet report...
I20260809 03:23:50.680240 16800 raft_consensus.cc:482] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:23:50.680464 16800 raft_consensus.cc:504] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } }
I20260809 03:23:50.680802 16800 leader_election.cc:288] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 551da98dbbeb4910a3869e5062a84e73 (127.8.5.195:35507), 6a2e9c54bded4533bb8af6cbd022b864 (127.8.5.193:45763)
I20260809 03:23:50.683470 16789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.681089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:41299 (local address 127.8.5.193:45763)
0809 03:23:50.681125 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:50.681127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:50.681136 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:23:50.681157 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:50.681157 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:50.681167 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:50.681215 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:50.681367 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.681800 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.682677 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.683105 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.683189 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.683197 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:50.683362 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 03:23:50.683401 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 03:23:50.683480 16792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.680929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:43183 (local address 127.8.5.195:35507)
0809 03:23:50.680969 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:50.680971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:50.680989 (+ 18us) server_negotiation.cc:407] Connection header received
0809 03:23:50.681056 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:50.681057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:50.681067 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:50.681142 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:50.681291 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.681745 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.682688 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.683110 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.683183 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.683192 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:50.683360 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 03:23:50.683418 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:23:50.683516 16492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.680890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:35507 (local address 127.8.5.194:43183)
0809 03:23:50.680942 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:50.680954 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:50.680996 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:50.681150 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:50.681151 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:50.681152 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:50.681209 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.681210 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.681824 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.681825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.682590 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.682592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.683182 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.683183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.683275 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.683278 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:23:50.683342 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 03:23:50.683410 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":50}
I20260809 03:23:50.683543 16802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.680921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:45763 (local address 127.8.5.194:41299)
0809 03:23:50.681038 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:50.681050 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:50.681101 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:50.681220 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:50.681221 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:50.681222 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:50.681291 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.681292 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.681875 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.681876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.682594 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.682596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.683193 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.683194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.683281 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.683285 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:23:50.683354 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 03:23:50.683413 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"mutex_wait_us":3,"thread_start_us":77,"threads_started":1}
I20260809 03:23:50.683854 16716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42f1068c379f45fcb05c29bd1f08ef41" candidate_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "551da98dbbeb4910a3869e5062a84e73" is_pre_election: true
I20260809 03:23:50.683971 16716 raft_consensus.cc:2454] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec1f54bfdf64171a3f8768eeb10e2a0 in term 0.
I20260809 03:23:50.684077 16407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42f1068c379f45fcb05c29bd1f08ef41" candidate_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2e9c54bded4533bb8af6cbd022b864" is_pre_election: true
I20260809 03:23:50.684180 16407 raft_consensus.cc:2454] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec1f54bfdf64171a3f8768eeb10e2a0 in term 0.
I20260809 03:23:50.684202 16486 leader_election.cc:302] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 551da98dbbeb4910a3869e5062a84e73, 5ec1f54bfdf64171a3f8768eeb10e2a0; no voters:
I20260809 03:23:50.684389 16800 raft_consensus.cc:2781] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:23:50.684451 16800 raft_consensus.cc:482] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:23:50.684476 16800 raft_consensus.cc:3037] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:50.685277 16800 raft_consensus.cc:504] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } }
I20260809 03:23:50.685431 16800 leader_election.cc:288] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [CANDIDATE]: Term 1 election: Requested vote from peers 551da98dbbeb4910a3869e5062a84e73 (127.8.5.195:35507), 6a2e9c54bded4533bb8af6cbd022b864 (127.8.5.193:45763)
I20260809 03:23:50.685573 16716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42f1068c379f45fcb05c29bd1f08ef41" candidate_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "551da98dbbeb4910a3869e5062a84e73"
I20260809 03:23:50.685606 16407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42f1068c379f45fcb05c29bd1f08ef41" candidate_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2e9c54bded4533bb8af6cbd022b864"
I20260809 03:23:50.685650 16716 raft_consensus.cc:3037] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:50.685678 16407 raft_consensus.cc:3037] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:50.686275 16407 raft_consensus.cc:2454] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec1f54bfdf64171a3f8768eeb10e2a0 in term 1.
I20260809 03:23:50.686299 16716 raft_consensus.cc:2454] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec1f54bfdf64171a3f8768eeb10e2a0 in term 1.
I20260809 03:23:50.686442 16487 leader_election.cc:302] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec1f54bfdf64171a3f8768eeb10e2a0, 6a2e9c54bded4533bb8af6cbd022b864; no voters:
I20260809 03:23:50.686571 16800 raft_consensus.cc:2781] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:50.686724 16800 raft_consensus.cc:686] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec1f54bfdf64171a3f8768eeb10e2a0, State: Running, Role: LEADER
I20260809 03:23:50.686810 16800 consensus_queue.cc:237] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } }
I20260809 03:23:50.687547 16244 catalog_manager.cc:5495] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec1f54bfdf64171a3f8768eeb10e2a0 (127.8.5.194). New cstate: current_term: 1 leader_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } health_report { overall_health: UNKNOWN } } }
I20260809 03:23:50.695741 16791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.693560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57772 (local address 127.8.5.194:37515)
0809 03:23:50.693606 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:50.693608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:50.693618 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:23:50.693683 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:50.693684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:50.693699 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:50.693753 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:50.693831 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.694276 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.695055 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.695231 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.695285 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.695409 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:50.695511 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:50.695603 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:50.695644 (+ 41us) server_negotiation.cc:299] Negotiation successful
0809 03:23:50.695663 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:23:50.697358 16407 raft_consensus.cc:1261] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864 [term 1 FOLLOWER]: Refusing update from remote peer 5ec1f54bfdf64171a3f8768eeb10e2a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:50.697391 16716 raft_consensus.cc:1261] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73 [term 1 FOLLOWER]: Refusing update from remote peer 5ec1f54bfdf64171a3f8768eeb10e2a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:50.697707 16803 consensus_queue.cc:1035] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:50.697849 16800 consensus_queue.cc:1035] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:50.700168 16806 mvcc.cc:205] Tried to move back new op lower bound from 7316462922533842944 to 7316462922493939712. Current Snapshot: MvccSnapshot[applied={T|T < 7316462922533842944}]
I20260809 03:23:50.700731 16808 mvcc.cc:205] Tried to move back new op lower bound from 7316462922533842944 to 7316462922493939712. Current Snapshot: MvccSnapshot[applied={T|T < 7316462922533842944}]
I20260809 03:23:50.700897 16807 mvcc.cc:205] Tried to move back new op lower bound from 7316462922533842944 to 7316462922493939712. Current Snapshot: MvccSnapshot[applied={T|T < 7316462922533842944}]
I20260809 03:23:50.702157 16243 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:50.702260 16243 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:50.702987 16243 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1: Sending DeleteTablet for 3 replicas of tablet 42f1068c379f45fcb05c29bd1f08ef41
I20260809 03:23:50.703341 16387 tablet_service.cc:1514] Processing DeleteTablet for tablet 42f1068c379f45fcb05c29bd1f08ef41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:50 UTC) from {username='oryx', principal='oryx/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:34498
I20260809 03:23:50.703567 16694 tablet_service.cc:1514] Processing DeleteTablet for tablet 42f1068c379f45fcb05c29bd1f08ef41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:50 UTC) from {username='oryx', principal='oryx/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:39338
I20260809 03:23:50.703809 16817 tablet_replica.cc:330] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864: stopping tablet replica
I20260809 03:23:50.703819 16818 tablet_replica.cc:330] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73: stopping tablet replica
I20260809 03:23:50.703876 16536 tablet_service.cc:1514] Processing DeleteTablet for tablet 42f1068c379f45fcb05c29bd1f08ef41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:50 UTC) from {username='oryx', principal='oryx/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:57756
I20260809 03:23:50.703918 16817 raft_consensus.cc:2229] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:50.704033 16817 raft_consensus.cc:2258] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:50.704039 16818 raft_consensus.cc:2229] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:50.704276 16243 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53980:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:23:50.704465 16243 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:23:50.704506 16817 ts_tablet_manager.cc:1905] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:50.704660 16818 raft_consensus.cc:2258] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:50.705158 16818 ts_tablet_manager.cc:1905] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:50.705717 16536 tablet_service.cc:1467] Processing CreateTablet for tablet 8ab1fea3bc1b4987a3955b25b0e04677 (DEFAULT_TABLE table=test-table [id=617cf3c5751e46b0ac0479ea2bb4af19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:50.705835 16536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ab1fea3bc1b4987a3955b25b0e04677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:50.706178 16817 ts_tablet_manager.cc:1918] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:23:50.706259 16817 log.cc:1196] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/wal/wals/42f1068c379f45fcb05c29bd1f08ef41
I20260809 03:23:50.706529 16817 ts_tablet_manager.cc:1939] T 42f1068c379f45fcb05c29bd1f08ef41 P 6a2e9c54bded4533bb8af6cbd022b864: Deleting consensus metadata
I20260809 03:23:50.707108 16228 catalog_manager.cc:4841] TS 6a2e9c54bded4533bb8af6cbd022b864 (127.8.5.193:45763): tablet 42f1068c379f45fcb05c29bd1f08ef41 (table test-table [id=5215796ea9004da9b34aab88727965cc]) successfully deleted
I20260809 03:23:50.707124 16818 ts_tablet_manager.cc:1918] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:23:50.707288 16818 log.cc:1196] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/42f1068c379f45fcb05c29bd1f08ef41
I20260809 03:23:50.707442 16795 tablet_bootstrap.cc:492] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0: Bootstrap starting.
I20260809 03:23:50.707427 16387 tablet_service.cc:1467] Processing CreateTablet for tablet 8ab1fea3bc1b4987a3955b25b0e04677 (DEFAULT_TABLE table=test-table [id=617cf3c5751e46b0ac0479ea2bb4af19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:50.707530 16387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ab1fea3bc1b4987a3955b25b0e04677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:50.707698 16818 ts_tablet_manager.cc:1939] T 42f1068c379f45fcb05c29bd1f08ef41 P 551da98dbbeb4910a3869e5062a84e73: Deleting consensus metadata
I20260809 03:23:50.707876 16795 tablet_bootstrap.cc:654] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:50.708161 16227 catalog_manager.cc:4841] TS 551da98dbbeb4910a3869e5062a84e73 (127.8.5.195:35507): tablet 42f1068c379f45fcb05c29bd1f08ef41 (table test-table [id=5215796ea9004da9b34aab88727965cc]) successfully deleted
I20260809 03:23:50.708709 16794 tablet_bootstrap.cc:492] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864: Bootstrap starting.
I20260809 03:23:50.708766 16694 tablet_service.cc:1467] Processing CreateTablet for tablet 8ab1fea3bc1b4987a3955b25b0e04677 (DEFAULT_TABLE table=test-table [id=617cf3c5751e46b0ac0479ea2bb4af19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:50.708881 16694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ab1fea3bc1b4987a3955b25b0e04677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:50.709115 16794 tablet_bootstrap.cc:654] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:50.709725 16794 tablet_bootstrap.cc:492] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864: No bootstrap required, opened a new log
I20260809 03:23:50.709772 16794 ts_tablet_manager.cc:1397] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260809 03:23:50.709806 16793 tablet_bootstrap.cc:492] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73: Bootstrap starting.
I20260809 03:23:50.709923 16794 raft_consensus.cc:348] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:50.709983 16794 raft_consensus.cc:374] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:50.710003 16794 raft_consensus.cc:729] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2e9c54bded4533bb8af6cbd022b864, State: Initialized, Role: FOLLOWER
I20260809 03:23:50.710060 16794 consensus_queue.cc:260] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:50.710090 16819 tablet_replica.cc:330] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0: stopping tablet replica
I20260809 03:23:50.710155 16794 ts_tablet_manager.cc:1428] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:50.710362 16793 tablet_bootstrap.cc:654] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:50.710263 16819 raft_consensus.cc:2229] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:23:50.710510 16819 raft_consensus.cc:2258] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:50.711113 16819 ts_tablet_manager.cc:1905] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:50.712224 16819 ts_tablet_manager.cc:1918] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:23:50.712297 16819 log.cc:1196] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/42f1068c379f45fcb05c29bd1f08ef41
I20260809 03:23:50.712517 16793 tablet_bootstrap.cc:492] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73: No bootstrap required, opened a new log
I20260809 03:23:50.712589 16793 ts_tablet_manager.cc:1397] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 03:23:50.712607 16819 ts_tablet_manager.cc:1939] T 42f1068c379f45fcb05c29bd1f08ef41 P 5ec1f54bfdf64171a3f8768eeb10e2a0: Deleting consensus metadata
I20260809 03:23:50.712746 16793 raft_consensus.cc:348] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:50.712819 16793 raft_consensus.cc:374] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:50.712841 16793 raft_consensus.cc:729] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 551da98dbbeb4910a3869e5062a84e73, State: Initialized, Role: FOLLOWER
I20260809 03:23:50.712883 16793 consensus_queue.cc:260] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:50.712960 16227 catalog_manager.cc:4841] TS 5ec1f54bfdf64171a3f8768eeb10e2a0 (127.8.5.194:37515): tablet 42f1068c379f45fcb05c29bd1f08ef41 (table test-table [id=5215796ea9004da9b34aab88727965cc]) successfully deleted
I20260809 03:23:50.712986 16793 ts_tablet_manager.cc:1428] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:50.715355 16795 tablet_bootstrap.cc:492] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0: No bootstrap required, opened a new log
I20260809 03:23:50.715399 16795 ts_tablet_manager.cc:1397] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.000s
I20260809 03:23:50.715512 16795 raft_consensus.cc:348] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:50.715559 16795 raft_consensus.cc:374] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:50.715572 16795 raft_consensus.cc:729] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec1f54bfdf64171a3f8768eeb10e2a0, State: Initialized, Role: FOLLOWER
I20260809 03:23:50.715600 16795 consensus_queue.cc:260] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:50.715687 16795 ts_tablet_manager.cc:1428] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260809 03:23:50.720567 16608 tablet.cc:2369] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:23:50.724354 16799 raft_consensus.cc:482] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:23:50.724412 16799 raft_consensus.cc:504] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:50.724742 16799 leader_election.cc:288] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a2e9c54bded4533bb8af6cbd022b864 (127.8.5.193:45763), 5ec1f54bfdf64171a3f8768eeb10e2a0 (127.8.5.194:37515)
I20260809 03:23:50.728965 16791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.724923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:37749 (local address 127.8.5.194:37515)
0809 03:23:50.724963 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:50.724966 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:50.724973 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:23:50.725062 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:50.725063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:50.725072 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:50.725117 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:50.725308 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.726056 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.728072 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.728610 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.728692 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.728699 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:50.728872 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 03:23:50.728910 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:23:50.728965 16651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.724874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:37515 (local address 127.8.5.195:37749)
0809 03:23:50.724921 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:50.724934 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:50.724975 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:50.725160 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:50.725161 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:50.725163 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:50.725231 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.725233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.726136 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.726137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.727260 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.727263 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.728688 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.728689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.728754 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.728758 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:23:50.728857 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 03:23:50.728899 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260809 03:23:50.729036 16789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.725034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:59549 (local address 127.8.5.193:45763)
0809 03:23:50.725074 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:50.725076 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:50.725107 (+ 31us) server_negotiation.cc:407] Connection header received
0809 03:23:50.725130 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:50.725131 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:50.725140 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:50.725191 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:23:50.725360 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.725820 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.727347 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.727957 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.728027 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.728037 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:50.728926 (+ 889us) server_negotiation.cc:299] Negotiation successful
0809 03:23:50.728970 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 03:23:50.729358 16823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.724885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:45763 (local address 127.8.5.195:59549)
0809 03:23:50.725018 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:50.725027 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:50.725070 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:50.725200 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:50.725201 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:50.725202 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:23:50.725300 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.725301 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.725902 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.725903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.727260 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.727263 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.728752 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.728753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.728825 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.728829 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:23:50.729203 (+ 374us) client_negotiation.cc:240] Negotiation successful
0809 03:23:50.729263 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":77,"thread_start_us":53,"threads_started":1}
I20260809 03:23:50.729377 16559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ab1fea3bc1b4987a3955b25b0e04677" candidate_uuid: "551da98dbbeb4910a3869e5062a84e73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" is_pre_election: true
I20260809 03:23:50.729475 16559 raft_consensus.cc:2454] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 551da98dbbeb4910a3869e5062a84e73 in term 0.
I20260809 03:23:50.729558 16407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ab1fea3bc1b4987a3955b25b0e04677" candidate_uuid: "551da98dbbeb4910a3869e5062a84e73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2e9c54bded4533bb8af6cbd022b864" is_pre_election: true
I20260809 03:23:50.729640 16407 raft_consensus.cc:2454] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 551da98dbbeb4910a3869e5062a84e73 in term 0.
I20260809 03:23:50.729666 16645 leader_election.cc:302] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 551da98dbbeb4910a3869e5062a84e73, 5ec1f54bfdf64171a3f8768eeb10e2a0; no voters:
I20260809 03:23:50.729768 16799 raft_consensus.cc:2781] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:23:50.729828 16799 raft_consensus.cc:482] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:23:50.729857 16799 raft_consensus.cc:3037] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:50.730482 16799 raft_consensus.cc:504] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:50.730619 16799 leader_election.cc:288] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [CANDIDATE]: Term 1 election: Requested vote from peers 6a2e9c54bded4533bb8af6cbd022b864 (127.8.5.193:45763), 5ec1f54bfdf64171a3f8768eeb10e2a0 (127.8.5.194:37515)
I20260809 03:23:50.730764 16407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ab1fea3bc1b4987a3955b25b0e04677" candidate_uuid: "551da98dbbeb4910a3869e5062a84e73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2e9c54bded4533bb8af6cbd022b864"
I20260809 03:23:50.730845 16407 raft_consensus.cc:3037] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:50.731128 16559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ab1fea3bc1b4987a3955b25b0e04677" candidate_uuid: "551da98dbbeb4910a3869e5062a84e73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0"
I20260809 03:23:50.731204 16559 raft_consensus.cc:3037] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:50.731637 16407 raft_consensus.cc:2454] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 551da98dbbeb4910a3869e5062a84e73 in term 1.
I20260809 03:23:50.731805 16646 leader_election.cc:302] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 551da98dbbeb4910a3869e5062a84e73, 6a2e9c54bded4533bb8af6cbd022b864; no voters:
I20260809 03:23:50.731901 16799 raft_consensus.cc:2781] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:50.732023 16799 raft_consensus.cc:686] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [term 1 LEADER]: Becoming Leader. State: Replica: 551da98dbbeb4910a3869e5062a84e73, State: Running, Role: LEADER
I20260809 03:23:50.732051 16559 raft_consensus.cc:2454] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 551da98dbbeb4910a3869e5062a84e73 in term 1.
I20260809 03:23:50.732091 16799 consensus_queue.cc:237] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:50.732717 16243 catalog_manager.cc:5495] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 551da98dbbeb4910a3869e5062a84e73 (127.8.5.195). New cstate: current_term: 1 leader_uuid: "551da98dbbeb4910a3869e5062a84e73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } health_report { overall_health: HEALTHY } } }
Aug 09 03:23:50 dist-test-slave-2w3w krb5kdc[16196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245830, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.254@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM
I20260809 03:23:50.767405 16832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.759735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33435 (local address 127.0.0.1:53984)
0809 03:23:50.759949 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:50.759961 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:50.760031 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:50.760188 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:50.760188 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:50.760502 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:50.760553 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.760555 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.761422 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.761423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.761989 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:50.761991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.762483 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.762484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:50.762534 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.763130 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:50.763135 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:50.764704 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:50.766356 (+ 1652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:50.766362 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:50.766364 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:50.766561 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:50.766774 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:50.766774 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:50.766774 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:50.766840 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:50.767111 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:50.767118 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:50.767161 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 03:23:50.767219 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 03:23:50.767310 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":116,"threads_started":1}
I20260809 03:23:50.767493 16295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.759810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53984 (local address 127.8.5.254:33435)
0809 03:23:50.759871 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:50.759874 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:50.760028 (+ 154us) server_negotiation.cc:407] Connection header received
0809 03:23:50.760080 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:50.760081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:50.760091 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:50.760178 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:50.760617 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.761338 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.762069 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:50.762398 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:50.762470 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:50.764786 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:50.764788 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:50.764788 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:50.764796 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:50.766274 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:50.766634 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:50.766636 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:50.766636 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:50.766700 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:50.766899 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:50.766900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:50.766901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:50.767050 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:50.767119 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:50.767268 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 03:23:50.767373 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":35}
I20260809 03:23:50.769645 16243 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:53984:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 03:23:50.769863 16243 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:23:50.771426 16536 tablet_service.cc:1467] Processing CreateTablet for tablet 29aa2afd8aeb426489c1612128e960ce (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a1812a99912846b09b1b83657338c23e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 03:23:50.771445 16387 tablet_service.cc:1467] Processing CreateTablet for tablet 29aa2afd8aeb426489c1612128e960ce (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a1812a99912846b09b1b83657338c23e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 03:23:50.771591 16536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29aa2afd8aeb426489c1612128e960ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:50.771591 16387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29aa2afd8aeb426489c1612128e960ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:50.773205 16794 tablet_bootstrap.cc:492] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864: Bootstrap starting.
I20260809 03:23:50.773293 16694 tablet_service.cc:1467] Processing CreateTablet for tablet 29aa2afd8aeb426489c1612128e960ce (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a1812a99912846b09b1b83657338c23e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 03:23:50.773447 16694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29aa2afd8aeb426489c1612128e960ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:50.773686 16794 tablet_bootstrap.cc:654] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:50.774415 16794 tablet_bootstrap.cc:492] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864: No bootstrap required, opened a new log
I20260809 03:23:50.774462 16794 ts_tablet_manager.cc:1397] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.001s
I20260809 03:23:50.774642 16794 raft_consensus.cc:348] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:50.774703 16794 raft_consensus.cc:374] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:50.774703 16793 tablet_bootstrap.cc:492] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73: Bootstrap starting.
I20260809 03:23:50.774722 16794 raft_consensus.cc:729] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2e9c54bded4533bb8af6cbd022b864, State: Initialized, Role: FOLLOWER
I20260809 03:23:50.774761 16795 tablet_bootstrap.cc:492] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0: Bootstrap starting.
I20260809 03:23:50.774776 16794 consensus_queue.cc:260] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:50.774860 16794 ts_tablet_manager.cc:1428] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:50.775027 16801 tablet_replica.cc:439] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } }
I20260809 03:23:50.775108 16801 tablet_replica.cc:442] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:50.775130 16793 tablet_bootstrap.cc:654] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:50.775130 16795 tablet_bootstrap.cc:654] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:50.775784 16795 tablet_bootstrap.cc:492] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0: No bootstrap required, opened a new log
I20260809 03:23:50.775835 16795 ts_tablet_manager.cc:1397] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:50.776131 16795 raft_consensus.cc:348] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:50.776193 16795 raft_consensus.cc:374] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:50.776207 16795 raft_consensus.cc:729] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec1f54bfdf64171a3f8768eeb10e2a0, State: Initialized, Role: FOLLOWER
I20260809 03:23:50.776263 16795 consensus_queue.cc:260] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:50.776381 16795 ts_tablet_manager.cc:1428] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 03:23:50.776397 16813 tablet_replica.cc:439] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } }
I20260809 03:23:50.776463 16813 tablet_replica.cc:442] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:50.776739 16793 tablet_bootstrap.cc:492] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73: No bootstrap required, opened a new log
I20260809 03:23:50.776798 16793 ts_tablet_manager.cc:1397] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:23:50.776947 16793 raft_consensus.cc:348] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:50.777014 16793 raft_consensus.cc:374] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:50.777043 16793 raft_consensus.cc:729] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 551da98dbbeb4910a3869e5062a84e73, State: Initialized, Role: FOLLOWER
I20260809 03:23:50.777084 16793 consensus_queue.cc:260] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:50.777192 16793 ts_tablet_manager.cc:1428] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:50.777323 16799 tablet_replica.cc:439] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } }
I20260809 03:23:50.777408 16799 tablet_replica.cc:442] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73: This TxnStatusTablet replica's current role is: FOLLOWER
W20260809 03:23:50.820140 16457 tablet.cc:2369] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 03:23:50.871275 16767 tablet.cc:2369] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:23:50.958940 16813 raft_consensus.cc:482] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:23:50.959070 16813 raft_consensus.cc:504] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:50.959263 16813 leader_election.cc:288] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a2e9c54bded4533bb8af6cbd022b864 (127.8.5.193:45763), 551da98dbbeb4910a3869e5062a84e73 (127.8.5.195:35507)
I20260809 03:23:50.959465 16407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29aa2afd8aeb426489c1612128e960ce" candidate_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2e9c54bded4533bb8af6cbd022b864" is_pre_election: true
I20260809 03:23:50.959580 16407 raft_consensus.cc:2454] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec1f54bfdf64171a3f8768eeb10e2a0 in term 0.
I20260809 03:23:50.959529 16716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29aa2afd8aeb426489c1612128e960ce" candidate_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "551da98dbbeb4910a3869e5062a84e73" is_pre_election: true
I20260809 03:23:50.959643 16716 raft_consensus.cc:2454] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec1f54bfdf64171a3f8768eeb10e2a0 in term 0.
I20260809 03:23:50.959789 16487 leader_election.cc:302] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec1f54bfdf64171a3f8768eeb10e2a0, 6a2e9c54bded4533bb8af6cbd022b864; no voters:
I20260809 03:23:50.959928 16813 raft_consensus.cc:2781] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:23:50.959982 16813 raft_consensus.cc:482] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:23:50.960011 16813 raft_consensus.cc:3037] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:50.960755 16813 raft_consensus.cc:504] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:50.960897 16813 leader_election.cc:288] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [CANDIDATE]: Term 1 election: Requested vote from peers 6a2e9c54bded4533bb8af6cbd022b864 (127.8.5.193:45763), 551da98dbbeb4910a3869e5062a84e73 (127.8.5.195:35507)
I20260809 03:23:50.961061 16716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29aa2afd8aeb426489c1612128e960ce" candidate_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "551da98dbbeb4910a3869e5062a84e73"
I20260809 03:23:50.961092 16407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29aa2afd8aeb426489c1612128e960ce" candidate_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2e9c54bded4533bb8af6cbd022b864"
I20260809 03:23:50.961149 16407 raft_consensus.cc:3037] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:50.961158 16716 raft_consensus.cc:3037] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:50.961760 16407 raft_consensus.cc:2454] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec1f54bfdf64171a3f8768eeb10e2a0 in term 1.
I20260809 03:23:50.961839 16716 raft_consensus.cc:2454] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec1f54bfdf64171a3f8768eeb10e2a0 in term 1.
I20260809 03:23:50.961956 16487 leader_election.cc:302] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec1f54bfdf64171a3f8768eeb10e2a0, 6a2e9c54bded4533bb8af6cbd022b864; no voters:
I20260809 03:23:50.962054 16813 raft_consensus.cc:2781] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:50.962102 16813 raft_consensus.cc:686] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec1f54bfdf64171a3f8768eeb10e2a0, State: Running, Role: LEADER
I20260809 03:23:50.962165 16813 consensus_queue.cc:237] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:50.962443 16803 tablet_replica.cc:439] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0: TxnStatusTablet state changed. Reason: New leader 5ec1f54bfdf64171a3f8768eeb10e2a0. Latest consensus state: current_term: 1 leader_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } }
I20260809 03:23:50.962531 16803 tablet_replica.cc:442] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0: This TxnStatusTablet replica's current role is: LEADER
I20260809 03:23:50.962719 16837 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 03:23:50.962841 16837 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 03:23:50.962774 16243 catalog_manager.cc:5495] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec1f54bfdf64171a3f8768eeb10e2a0 (127.8.5.194). New cstate: current_term: 1 leader_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } health_report { overall_health: UNKNOWN } } }
I20260809 03:23:51.002424 16791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:51.000022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57780 (local address 127.8.5.194:37515)
0809 03:23:51.000088 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:51.000090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:51.000099 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:23:51.000201 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:51.000202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:51.000215 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:51.000263 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:51.000408 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.000947 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.001709 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.001944 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.002003 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:51.002168 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:51.002204 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:51.002252 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:51.002314 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 03:23:51.002336 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 03:23:51.002456 16832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:50.999955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:37515 (local address 127.0.0.1:57780)
0809 03:23:51.000018 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:51.000033 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:51.000111 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:51.000277 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:51.000277 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:51.000278 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 03:23:51.000335 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:51.000337 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.001048 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.001049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:51.001617 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:51.001619 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.002003 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.002004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:51.002072 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:51.002087 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 03:23:51.002251 (+ 164us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 03:23:51.002257 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 03:23:51.002310 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 03:23:51.002360 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260809 03:23:51.003661 16716 raft_consensus.cc:1261] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73 [term 1 FOLLOWER]: Refusing update from remote peer 5ec1f54bfdf64171a3f8768eeb10e2a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:51.003671 16407 raft_consensus.cc:1261] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864 [term 1 FOLLOWER]: Refusing update from remote peer 5ec1f54bfdf64171a3f8768eeb10e2a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:51.003904 16803 consensus_queue.cc:1035] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:51.004068 16813 consensus_queue.cc:1035] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:51.004463 16799 tablet_replica.cc:439] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73: TxnStatusTablet state changed. Reason: New leader 5ec1f54bfdf64171a3f8768eeb10e2a0. Latest consensus state: current_term: 1 leader_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } }
I20260809 03:23:51.004558 16799 tablet_replica.cc:442] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:51.004545 16801 tablet_replica.cc:439] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864: TxnStatusTablet state changed. Reason: New leader 5ec1f54bfdf64171a3f8768eeb10e2a0. Latest consensus state: current_term: 1 leader_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } }
I20260809 03:23:51.004648 16801 tablet_replica.cc:442] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:51.005357 16800 tablet_replica.cc:439] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } }
I20260809 03:23:51.005446 16800 tablet_replica.cc:442] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0: This TxnStatusTablet replica's current role is: LEADER
I20260809 03:23:51.005523 16799 tablet_replica.cc:439] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } }
I20260809 03:23:51.005609 16799 tablet_replica.cc:442] T 29aa2afd8aeb426489c1612128e960ce P 551da98dbbeb4910a3869e5062a84e73: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:51.006130 16803 tablet_replica.cc:439] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } }
I20260809 03:23:51.006214 16803 tablet_replica.cc:442] T 29aa2afd8aeb426489c1612128e960ce P 5ec1f54bfdf64171a3f8768eeb10e2a0: This TxnStatusTablet replica's current role is: LEADER
I20260809 03:23:51.006542 16801 tablet_replica.cc:439] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } } }
I20260809 03:23:51.006625 16801 tablet_replica.cc:442] T 29aa2afd8aeb426489c1612128e960ce P 6a2e9c54bded4533bb8af6cbd022b864: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 03:23:51.009389 16792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:51.007078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39340 (local address 127.8.5.195:35507)
0809 03:23:51.007112 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:51.007114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:51.007120 (+ 6us) server_negotiation.cc:407] Connection header received
0809 03:23:51.007169 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:51.007169 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:51.007188 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:51.007255 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:51.007429 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.007877 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.008594 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.008802 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.008873 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:51.009043 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:51.009151 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:51.009229 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:51.009287 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 03:23:51.009308 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 03:23:51.013898 16791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:51.011774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:47159 (local address 127.8.5.194:37515)
0809 03:23:51.011813 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:51.011815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:51.011837 (+ 22us) server_negotiation.cc:407] Connection header received
0809 03:23:51.011908 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:51.011909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:51.011919 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:51.011967 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:51.012079 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.012517 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.013240 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.013430 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.013499 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:51.013662 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:51.013698 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:51.013748 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:51.013814 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 03:23:51.013833 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:23:51.013931 16772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:51.011689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:37515 (local address 127.8.5.195:47159)
0809 03:23:51.011784 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:51.011797 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:51.011860 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:51.011968 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:51.011969 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:51.011970 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 03:23:51.012024 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:51.012026 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.012596 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.012597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:51.013150 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:51.013151 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.013500 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.013501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:51.013567 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:51.013586 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 03:23:51.013769 (+ 183us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 03:23:51.013771 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:23:51.013813 (+ 42us) client_negotiation.cc:240] Negotiation successful
0809 03:23:51.013860 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 03:23:51.015878 16407 raft_consensus.cc:1261] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864 [term 1 FOLLOWER]: Refusing update from remote peer 551da98dbbeb4910a3869e5062a84e73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:51.016073 16559 raft_consensus.cc:1261] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 FOLLOWER]: Refusing update from remote peer 551da98dbbeb4910a3869e5062a84e73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:51.016345 16799 consensus_queue.cc:1035] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:51.016464 16824 consensus_queue.cc:1035] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:51.025084 16792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:51.022229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:36495 (local address 127.8.5.195:35507)
0809 03:23:51.022277 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:51.022279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:51.022378 (+ 99us) server_negotiation.cc:407] Connection header received
0809 03:23:51.022435 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:51.022436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:51.022445 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:51.022489 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:51.022588 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.023204 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.024339 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.024668 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.024720 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:51.024906 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:51.024931 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:51.024967 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:51.025020 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 03:23:51.025036 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 03:23:51.025146 16847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:51.022121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:35507 (local address 127.8.5.194:36495)
0809 03:23:51.022297 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:51.022309 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:51.022380 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:51.022492 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:51.022492 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:51.022494 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 03:23:51.022538 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:51.022539 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.023268 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.023269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:51.024263 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:51.024265 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.024751 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.024752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:51.024811 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:51.024828 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 03:23:51.024969 (+ 141us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 03:23:51.024970 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 03:23:51.025017 (+ 47us) client_negotiation.cc:240] Negotiation successful
0809 03:23:51.025060 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":103,"threads_started":1}
I20260809 03:23:51.033443 16243 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:51.033545 16243 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:51.034164 16243 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1: Sending DeleteTablet for 3 replicas of tablet 8ab1fea3bc1b4987a3955b25b0e04677
I20260809 03:23:51.034394 16536 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ab1fea3bc1b4987a3955b25b0e04677 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:51 UTC) from {username='oryx', principal='oryx/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:57756
I20260809 03:23:51.034430 16694 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ab1fea3bc1b4987a3955b25b0e04677 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:51 UTC) from {username='oryx', principal='oryx/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:39338
I20260809 03:23:51.034492 16819 tablet_replica.cc:330] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0: stopping tablet replica
I20260809 03:23:51.034514 16818 tablet_replica.cc:330] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73: stopping tablet replica
I20260809 03:23:51.034547 16819 raft_consensus.cc:2229] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:51.034559 16818 raft_consensus.cc:2229] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:23:51.034578 16819 raft_consensus.cc:2258] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:51.034644 16818 raft_consensus.cc:2258] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:51.034914 16819 ts_tablet_manager.cc:1905] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:51.034992 16818 ts_tablet_manager.cc:1905] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:51.036799 16387 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ab1fea3bc1b4987a3955b25b0e04677 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:51 UTC) from {username='oryx', principal='oryx/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:34498
I20260809 03:23:51.036865 16819 ts_tablet_manager.cc:1918] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 03:23:51.036919 16819 log.cc:1196] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/8ab1fea3bc1b4987a3955b25b0e04677
I20260809 03:23:51.036914 16817 tablet_replica.cc:330] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864: stopping tablet replica
I20260809 03:23:51.036971 16817 raft_consensus.cc:2229] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:51.037034 16817 raft_consensus.cc:2258] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:51.037171 16819 ts_tablet_manager.cc:1939] T 8ab1fea3bc1b4987a3955b25b0e04677 P 5ec1f54bfdf64171a3f8768eeb10e2a0: Deleting consensus metadata
I20260809 03:23:51.037458 16817 ts_tablet_manager.cc:1905] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:51.037606 16227 catalog_manager.cc:4841] TS 5ec1f54bfdf64171a3f8768eeb10e2a0 (127.8.5.194:37515): tablet 8ab1fea3bc1b4987a3955b25b0e04677 (table test-table [id=617cf3c5751e46b0ac0479ea2bb4af19]) successfully deleted
I20260809 03:23:51.038749 16817 ts_tablet_manager.cc:1918] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 03:23:51.038807 16817 log.cc:1196] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/wal/wals/8ab1fea3bc1b4987a3955b25b0e04677
I20260809 03:23:51.039052 16817 ts_tablet_manager.cc:1939] T 8ab1fea3bc1b4987a3955b25b0e04677 P 6a2e9c54bded4533bb8af6cbd022b864: Deleting consensus metadata
I20260809 03:23:51.039455 16228 catalog_manager.cc:4841] TS 6a2e9c54bded4533bb8af6cbd022b864 (127.8.5.193:45763): tablet 8ab1fea3bc1b4987a3955b25b0e04677 (table test-table [id=617cf3c5751e46b0ac0479ea2bb4af19]) successfully deleted
I20260809 03:23:51.040390 16818 ts_tablet_manager.cc:1918] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 03:23:51.040457 16818 log.cc:1196] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/8ab1fea3bc1b4987a3955b25b0e04677
I20260809 03:23:51.040684 16818 ts_tablet_manager.cc:1939] T 8ab1fea3bc1b4987a3955b25b0e04677 P 551da98dbbeb4910a3869e5062a84e73: Deleting consensus metadata
I20260809 03:23:51.041020 16227 catalog_manager.cc:4841] TS 551da98dbbeb4910a3869e5062a84e73 (127.8.5.195:35507): tablet 8ab1fea3bc1b4987a3955b25b0e04677 (table test-table [id=617cf3c5751e46b0ac0479ea2bb4af19]) successfully deleted
Aug 09 03:23:51 dist-test-slave-2w3w krb5kdc[16196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 03:23:51 dist-test-slave-2w3w krb5kdc[16196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:51 dist-test-slave-2w3w krb5kdc[16196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 03:23:51.069548 16295 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:51.062508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53994 (local address 127.8.5.254:33435)
0809 03:23:51.062578 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:51.062580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:51.062818 (+ 238us) server_negotiation.cc:407] Connection header received
0809 03:23:51.062893 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:51.062895 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:51.062908 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:51.063008 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:51.063742 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.064503 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.065643 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.065915 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.065993 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:51.069479 (+ 3486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53994: BlockingRecv error: recv got EOF from 127.0.0.1:53994 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 09 03:23:51 dist-test-slave-2w3w krb5kdc[16196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM
I20260809 03:23:51.079561 16295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:51.070590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53996 (local address 127.8.5.254:33435)
0809 03:23:51.070631 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:51.070633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:51.071139 (+ 506us) server_negotiation.cc:407] Connection header received
0809 03:23:51.071187 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:51.071188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:51.071199 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:51.071258 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:51.071805 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.072555 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.073555 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.073892 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.073958 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:51.076592 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:51.076594 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:51.076594 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:51.076602 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:51.078303 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:51.078680 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:51.078682 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:51.078682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:51.078756 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:51.078991 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:51.078992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:51.078992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:51.079149 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:51.079254 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:51.079381 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 03:23:51.079464 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:23:51.081197 16243 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53996:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:23:51.081379 16243 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:23:51.082680 16536 tablet_service.cc:1467] Processing CreateTablet for tablet 54fa01187c2b459d8069aa530231ccfb (DEFAULT_TABLE table=test-table [id=cc1f31589b984740bf36da5df1fcc58e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:51.082758 16387 tablet_service.cc:1467] Processing CreateTablet for tablet 54fa01187c2b459d8069aa530231ccfb (DEFAULT_TABLE table=test-table [id=cc1f31589b984740bf36da5df1fcc58e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:51.082840 16536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54fa01187c2b459d8069aa530231ccfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:51.082911 16387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54fa01187c2b459d8069aa530231ccfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:51.084362 16694 tablet_service.cc:1467] Processing CreateTablet for tablet 54fa01187c2b459d8069aa530231ccfb (DEFAULT_TABLE table=test-table [id=cc1f31589b984740bf36da5df1fcc58e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:51.084467 16795 tablet_bootstrap.cc:492] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0: Bootstrap starting.
I20260809 03:23:51.084481 16694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54fa01187c2b459d8069aa530231ccfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:51.084796 16795 tablet_bootstrap.cc:654] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:51.085716 16794 tablet_bootstrap.cc:492] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864: Bootstrap starting.
I20260809 03:23:51.085757 16795 tablet_bootstrap.cc:492] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0: No bootstrap required, opened a new log
I20260809 03:23:51.085805 16795 ts_tablet_manager.cc:1397] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:51.085908 16795 raft_consensus.cc:348] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:51.085973 16795 raft_consensus.cc:374] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:51.085992 16795 raft_consensus.cc:729] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec1f54bfdf64171a3f8768eeb10e2a0, State: Initialized, Role: FOLLOWER
I20260809 03:23:51.086037 16795 consensus_queue.cc:260] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:51.086122 16795 ts_tablet_manager.cc:1428] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:51.086190 16794 tablet_bootstrap.cc:654] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:51.086512 16793 tablet_bootstrap.cc:492] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73: Bootstrap starting.
I20260809 03:23:51.086908 16793 tablet_bootstrap.cc:654] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:51.088305 16794 tablet_bootstrap.cc:492] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864: No bootstrap required, opened a new log
I20260809 03:23:51.088352 16794 ts_tablet_manager.cc:1397] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20260809 03:23:51.088501 16794 raft_consensus.cc:348] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:51.088560 16794 raft_consensus.cc:374] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:51.088579 16794 raft_consensus.cc:729] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2e9c54bded4533bb8af6cbd022b864, State: Initialized, Role: FOLLOWER
I20260809 03:23:51.088618 16794 consensus_queue.cc:260] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:51.088701 16794 ts_tablet_manager.cc:1428] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:51.089136 16793 tablet_bootstrap.cc:492] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73: No bootstrap required, opened a new log
I20260809 03:23:51.089183 16793 ts_tablet_manager.cc:1397] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 03:23:51.089316 16793 raft_consensus.cc:348] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:51.089375 16793 raft_consensus.cc:374] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:51.089393 16793 raft_consensus.cc:729] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 551da98dbbeb4910a3869e5062a84e73, State: Initialized, Role: FOLLOWER
I20260809 03:23:51.089432 16793 consensus_queue.cc:260] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:51.089514 16793 ts_tablet_manager.cc:1428] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:51.246708 16824 raft_consensus.cc:482] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:23:51.246833 16824 raft_consensus.cc:504] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:51.247066 16824 leader_election.cc:288] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a2e9c54bded4533bb8af6cbd022b864 (127.8.5.193:45763), 5ec1f54bfdf64171a3f8768eeb10e2a0 (127.8.5.194:37515)
I20260809 03:23:51.247310 16407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54fa01187c2b459d8069aa530231ccfb" candidate_uuid: "551da98dbbeb4910a3869e5062a84e73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2e9c54bded4533bb8af6cbd022b864" is_pre_election: true
I20260809 03:23:51.247315 16559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54fa01187c2b459d8069aa530231ccfb" candidate_uuid: "551da98dbbeb4910a3869e5062a84e73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" is_pre_election: true
I20260809 03:23:51.247417 16407 raft_consensus.cc:2454] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 551da98dbbeb4910a3869e5062a84e73 in term 0.
I20260809 03:23:51.247419 16559 raft_consensus.cc:2454] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 551da98dbbeb4910a3869e5062a84e73 in term 0.
I20260809 03:23:51.247593 16646 leader_election.cc:302] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 551da98dbbeb4910a3869e5062a84e73, 6a2e9c54bded4533bb8af6cbd022b864; no voters:
I20260809 03:23:51.247717 16824 raft_consensus.cc:2781] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:23:51.247784 16824 raft_consensus.cc:482] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:23:51.247825 16824 raft_consensus.cc:3037] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:51.248550 16824 raft_consensus.cc:504] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:51.248687 16824 leader_election.cc:288] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [CANDIDATE]: Term 1 election: Requested vote from peers 6a2e9c54bded4533bb8af6cbd022b864 (127.8.5.193:45763), 5ec1f54bfdf64171a3f8768eeb10e2a0 (127.8.5.194:37515)
I20260809 03:23:51.248857 16407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54fa01187c2b459d8069aa530231ccfb" candidate_uuid: "551da98dbbeb4910a3869e5062a84e73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2e9c54bded4533bb8af6cbd022b864"
I20260809 03:23:51.248860 16559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54fa01187c2b459d8069aa530231ccfb" candidate_uuid: "551da98dbbeb4910a3869e5062a84e73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0"
I20260809 03:23:51.248942 16407 raft_consensus.cc:3037] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:51.248942 16559 raft_consensus.cc:3037] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:51.249743 16407 raft_consensus.cc:2454] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 551da98dbbeb4910a3869e5062a84e73 in term 1.
I20260809 03:23:51.249743 16559 raft_consensus.cc:2454] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 551da98dbbeb4910a3869e5062a84e73 in term 1.
I20260809 03:23:51.249938 16646 leader_election.cc:302] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 551da98dbbeb4910a3869e5062a84e73, 6a2e9c54bded4533bb8af6cbd022b864; no voters:
I20260809 03:23:51.250039 16824 raft_consensus.cc:2781] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:51.250119 16824 raft_consensus.cc:686] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [term 1 LEADER]: Becoming Leader. State: Replica: 551da98dbbeb4910a3869e5062a84e73, State: Running, Role: LEADER
I20260809 03:23:51.250177 16824 consensus_queue.cc:237] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:51.250803 16243 catalog_manager.cc:5495] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 551da98dbbeb4910a3869e5062a84e73 (127.8.5.195). New cstate: current_term: 1 leader_uuid: "551da98dbbeb4910a3869e5062a84e73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } health_report { overall_health: HEALTHY } } }
I20260809 03:23:51.267751 16792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:51.265522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39350 (local address 127.8.5.195:35507)
0809 03:23:51.265583 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:51.265585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:51.265592 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:23:51.265664 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:51.265664 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:51.265673 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:51.265718 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:23:51.265842 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.266298 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.267098 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:51.267294 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:51.267363 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:51.267486 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:23:51.267514 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:23:51.267555 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:51.267646 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 03:23:51.267663 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 03:23:51.268628 16559 raft_consensus.cc:1261] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 FOLLOWER]: Refusing update from remote peer 551da98dbbeb4910a3869e5062a84e73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:51.268659 16407 raft_consensus.cc:1261] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864 [term 1 FOLLOWER]: Refusing update from remote peer 551da98dbbeb4910a3869e5062a84e73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:51.268879 16799 consensus_queue.cc:1035] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:51.269003 16799 consensus_queue.cc:1035] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:51.271946 16243 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:51.272073 16243 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:51.272787 16243 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1: Sending DeleteTablet for 3 replicas of tablet 54fa01187c2b459d8069aa530231ccfb
I20260809 03:23:51.273038 16536 tablet_service.cc:1514] Processing DeleteTablet for tablet 54fa01187c2b459d8069aa530231ccfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:51 UTC) from {username='oryx', principal='oryx/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:57756
I20260809 03:23:51.273058 16694 tablet_service.cc:1514] Processing DeleteTablet for tablet 54fa01187c2b459d8069aa530231ccfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:51 UTC) from {username='oryx', principal='oryx/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:39338
I20260809 03:23:51.273088 16387 tablet_service.cc:1514] Processing DeleteTablet for tablet 54fa01187c2b459d8069aa530231ccfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:51 UTC) from {username='oryx', principal='oryx/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:34498
I20260809 03:23:51.273142 16818 tablet_replica.cc:330] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73: stopping tablet replica
I20260809 03:23:51.273144 16819 tablet_replica.cc:330] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0: stopping tablet replica
I20260809 03:23:51.273177 16817 tablet_replica.cc:330] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864: stopping tablet replica
I20260809 03:23:51.273186 16818 raft_consensus.cc:2229] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:23:51.273188 16819 raft_consensus.cc:2229] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:51.273232 16819 raft_consensus.cc:2258] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:51.273226 16817 raft_consensus.cc:2229] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:51.273244 16818 raft_consensus.cc:2258] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:51.273288 16817 raft_consensus.cc:2258] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:51.273571 16817 ts_tablet_manager.cc:1905] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:51.273581 16818 ts_tablet_manager.cc:1905] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:51.273653 16243 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53996:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:23:51.273818 16243 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:23:51.274993 16387 tablet_service.cc:1467] Processing CreateTablet for tablet 8bc3457ea051426681dcbd78bf10917b (DEFAULT_TABLE table=test-table [id=1656353dc495445a9489eed0e45e7d3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:51.275040 16694 tablet_service.cc:1467] Processing CreateTablet for tablet 8bc3457ea051426681dcbd78bf10917b (DEFAULT_TABLE table=test-table [id=1656353dc495445a9489eed0e45e7d3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:51.275133 16694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bc3457ea051426681dcbd78bf10917b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:51.275133 16387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bc3457ea051426681dcbd78bf10917b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:51.275236 16818 ts_tablet_manager.cc:1918] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:23:51.275295 16818 log.cc:1196] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/54fa01187c2b459d8069aa530231ccfb
I20260809 03:23:51.275506 16818 ts_tablet_manager.cc:1939] T 54fa01187c2b459d8069aa530231ccfb P 551da98dbbeb4910a3869e5062a84e73: Deleting consensus metadata
I20260809 03:23:51.275796 16227 catalog_manager.cc:4841] TS 551da98dbbeb4910a3869e5062a84e73 (127.8.5.195:35507): tablet 54fa01187c2b459d8069aa530231ccfb (table test-table [id=cc1f31589b984740bf36da5df1fcc58e]) successfully deleted
I20260809 03:23:51.276309 16794 tablet_bootstrap.cc:492] T 8bc3457ea051426681dcbd78bf10917b P 6a2e9c54bded4533bb8af6cbd022b864: Bootstrap starting.
I20260809 03:23:51.276382 16793 tablet_bootstrap.cc:492] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73: Bootstrap starting.
I20260809 03:23:51.276755 16793 tablet_bootstrap.cc:654] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:51.276964 16794 tablet_bootstrap.cc:654] T 8bc3457ea051426681dcbd78bf10917b P 6a2e9c54bded4533bb8af6cbd022b864: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:51.277163 16536 tablet_service.cc:1467] Processing CreateTablet for tablet 8bc3457ea051426681dcbd78bf10917b (DEFAULT_TABLE table=test-table [id=1656353dc495445a9489eed0e45e7d3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:23:51.277253 16819 ts_tablet_manager.cc:1905] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:51.277274 16536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bc3457ea051426681dcbd78bf10917b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:51.277511 16793 tablet_bootstrap.cc:492] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73: No bootstrap required, opened a new log
I20260809 03:23:51.277558 16793 ts_tablet_manager.cc:1397] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:51.277699 16794 tablet_bootstrap.cc:492] T 8bc3457ea051426681dcbd78bf10917b P 6a2e9c54bded4533bb8af6cbd022b864: No bootstrap required, opened a new log
I20260809 03:23:51.277674 16793 raft_consensus.cc:348] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:51.277736 16793 raft_consensus.cc:374] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:51.277747 16794 ts_tablet_manager.cc:1397] T 8bc3457ea051426681dcbd78bf10917b P 6a2e9c54bded4533bb8af6cbd022b864: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260809 03:23:51.277760 16793 raft_consensus.cc:729] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 551da98dbbeb4910a3869e5062a84e73, State: Initialized, Role: FOLLOWER
I20260809 03:23:51.277805 16793 consensus_queue.cc:260] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:51.277915 16793 ts_tablet_manager.cc:1428] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:51.277889 16794 raft_consensus.cc:348] T 8bc3457ea051426681dcbd78bf10917b P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:51.277951 16794 raft_consensus.cc:374] T 8bc3457ea051426681dcbd78bf10917b P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:51.277972 16794 raft_consensus.cc:729] T 8bc3457ea051426681dcbd78bf10917b P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2e9c54bded4533bb8af6cbd022b864, State: Initialized, Role: FOLLOWER
I20260809 03:23:51.278017 16794 consensus_queue.cc:260] T 8bc3457ea051426681dcbd78bf10917b P 6a2e9c54bded4533bb8af6cbd022b864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:51.278126 16794 ts_tablet_manager.cc:1428] T 8bc3457ea051426681dcbd78bf10917b P 6a2e9c54bded4533bb8af6cbd022b864: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:51.275142 16817 ts_tablet_manager.cc:1918] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:23:51.278299 16817 log.cc:1196] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-0/wal/wals/54fa01187c2b459d8069aa530231ccfb
I20260809 03:23:51.278541 16817 ts_tablet_manager.cc:1939] T 54fa01187c2b459d8069aa530231ccfb P 6a2e9c54bded4533bb8af6cbd022b864: Deleting consensus metadata
I20260809 03:23:51.278695 16795 tablet_bootstrap.cc:492] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0: Bootstrap starting.
I20260809 03:23:51.278839 16228 catalog_manager.cc:4841] TS 6a2e9c54bded4533bb8af6cbd022b864 (127.8.5.193:45763): tablet 54fa01187c2b459d8069aa530231ccfb (table test-table [id=cc1f31589b984740bf36da5df1fcc58e]) successfully deleted
I20260809 03:23:51.279044 16795 tablet_bootstrap.cc:654] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:51.279536 16819 ts_tablet_manager.cc:1918] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:23:51.279592 16819 log.cc:1196] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/54fa01187c2b459d8069aa530231ccfb
I20260809 03:23:51.279652 16795 tablet_bootstrap.cc:492] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0: No bootstrap required, opened a new log
I20260809 03:23:51.279700 16795 ts_tablet_manager.cc:1397] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 03:23:51.279809 16819 ts_tablet_manager.cc:1939] T 54fa01187c2b459d8069aa530231ccfb P 5ec1f54bfdf64171a3f8768eeb10e2a0: Deleting consensus metadata
I20260809 03:23:51.279800 16795 raft_consensus.cc:348] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:51.279920 16795 raft_consensus.cc:374] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:51.279951 16795 raft_consensus.cc:729] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec1f54bfdf64171a3f8768eeb10e2a0, State: Initialized, Role: FOLLOWER
I20260809 03:23:51.279996 16795 consensus_queue.cc:260] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:51.280083 16795 ts_tablet_manager.cc:1428] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:51.280340 16227 catalog_manager.cc:4841] TS 5ec1f54bfdf64171a3f8768eeb10e2a0 (127.8.5.194:37515): tablet 54fa01187c2b459d8069aa530231ccfb (table test-table [id=cc1f31589b984740bf36da5df1fcc58e]) successfully deleted
I20260809 03:23:51.370443 16799 raft_consensus.cc:482] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:23:51.370556 16799 raft_consensus.cc:504] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:51.370743 16799 leader_election.cc:288] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a2e9c54bded4533bb8af6cbd022b864 (127.8.5.193:45763), 5ec1f54bfdf64171a3f8768eeb10e2a0 (127.8.5.194:37515)
I20260809 03:23:51.371022 16559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc3457ea051426681dcbd78bf10917b" candidate_uuid: "551da98dbbeb4910a3869e5062a84e73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" is_pre_election: true
I20260809 03:23:51.371007 16407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc3457ea051426681dcbd78bf10917b" candidate_uuid: "551da98dbbeb4910a3869e5062a84e73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2e9c54bded4533bb8af6cbd022b864" is_pre_election: true
I20260809 03:23:51.371114 16559 raft_consensus.cc:2454] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 551da98dbbeb4910a3869e5062a84e73 in term 0.
I20260809 03:23:51.371129 16407 raft_consensus.cc:2454] T 8bc3457ea051426681dcbd78bf10917b P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 551da98dbbeb4910a3869e5062a84e73 in term 0.
I20260809 03:23:51.371310 16646 leader_election.cc:302] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 551da98dbbeb4910a3869e5062a84e73, 6a2e9c54bded4533bb8af6cbd022b864; no voters:
I20260809 03:23:51.371431 16799 raft_consensus.cc:2781] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:23:51.371502 16799 raft_consensus.cc:482] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:23:51.371536 16799 raft_consensus.cc:3037] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:51.372285 16799 raft_consensus.cc:504] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:51.372444 16799 leader_election.cc:288] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [CANDIDATE]: Term 1 election: Requested vote from peers 6a2e9c54bded4533bb8af6cbd022b864 (127.8.5.193:45763), 5ec1f54bfdf64171a3f8768eeb10e2a0 (127.8.5.194:37515)
I20260809 03:23:51.372578 16407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc3457ea051426681dcbd78bf10917b" candidate_uuid: "551da98dbbeb4910a3869e5062a84e73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2e9c54bded4533bb8af6cbd022b864"
I20260809 03:23:51.372610 16559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc3457ea051426681dcbd78bf10917b" candidate_uuid: "551da98dbbeb4910a3869e5062a84e73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0"
I20260809 03:23:51.372684 16407 raft_consensus.cc:3037] T 8bc3457ea051426681dcbd78bf10917b P 6a2e9c54bded4533bb8af6cbd022b864 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:51.372689 16559 raft_consensus.cc:3037] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:51.373324 16559 raft_consensus.cc:2454] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 551da98dbbeb4910a3869e5062a84e73 in term 1.
I20260809 03:23:51.373418 16407 raft_consensus.cc:2454] T 8bc3457ea051426681dcbd78bf10917b P 6a2e9c54bded4533bb8af6cbd022b864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 551da98dbbeb4910a3869e5062a84e73 in term 1.
I20260809 03:23:51.373502 16645 leader_election.cc:302] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 551da98dbbeb4910a3869e5062a84e73, 5ec1f54bfdf64171a3f8768eeb10e2a0; no voters:
I20260809 03:23:51.373605 16799 raft_consensus.cc:2781] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:51.373677 16799 raft_consensus.cc:686] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [term 1 LEADER]: Becoming Leader. State: Replica: 551da98dbbeb4910a3869e5062a84e73, State: Running, Role: LEADER
I20260809 03:23:51.373754 16799 consensus_queue.cc:237] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } }
I20260809 03:23:51.374351 16243 catalog_manager.cc:5495] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 551da98dbbeb4910a3869e5062a84e73 (127.8.5.195). New cstate: current_term: 1 leader_uuid: "551da98dbbeb4910a3869e5062a84e73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "551da98dbbeb4910a3869e5062a84e73" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35507 } health_report { overall_health: HEALTHY } } }
I20260809 03:23:51.395440 16559 raft_consensus.cc:1261] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 FOLLOWER]: Refusing update from remote peer 551da98dbbeb4910a3869e5062a84e73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:51.395457 16407 raft_consensus.cc:1261] T 8bc3457ea051426681dcbd78bf10917b P 6a2e9c54bded4533bb8af6cbd022b864 [term 1 FOLLOWER]: Refusing update from remote peer 551da98dbbeb4910a3869e5062a84e73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:23:51.395661 16824 consensus_queue.cc:1035] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec1f54bfdf64171a3f8768eeb10e2a0" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:51.395785 16799 consensus_queue.cc:1035] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2e9c54bded4533bb8af6cbd022b864" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:23:51.405097 16243 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:51.405189 16243 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:23:51.405788 16243 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 68e3b36849694b80865873cab64a81a1: Sending DeleteTablet for 3 replicas of tablet 8bc3457ea051426681dcbd78bf10917b
I20260809 03:23:51.406054 16536 tablet_service.cc:1514] Processing DeleteTablet for tablet 8bc3457ea051426681dcbd78bf10917b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:51 UTC) from {username='oryx', principal='oryx/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:57756
I20260809 03:23:51.406087 16694 tablet_service.cc:1514] Processing DeleteTablet for tablet 8bc3457ea051426681dcbd78bf10917b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:51 UTC) from {username='oryx', principal='oryx/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:39338
I20260809 03:23:51.406114 16387 tablet_service.cc:1514] Processing DeleteTablet for tablet 8bc3457ea051426681dcbd78bf10917b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:23:51 UTC) from {username='oryx', principal='oryx/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:34498
I20260809 03:23:51.406179 16818 tablet_replica.cc:330] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73: stopping tablet replica
I20260809 03:23:51.406224 16818 raft_consensus.cc:2229] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:23:51.406258 16819 tablet_replica.cc:330] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0: stopping tablet replica
I20260809 03:23:51.406296 16818 raft_consensus.cc:2258] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:51.406332 16819 raft_consensus.cc:2229] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:51.406368 16819 raft_consensus.cc:2258] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:51.406368 16817 tablet_replica.cc:330] T 8bc3457ea051426681dcbd78bf10917b P 6a2e9c54bded4533bb8af6cbd022b864: stopping tablet replica
I20260809 03:23:51.406375 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 16318
I20260809 03:23:51.406419 16817 raft_consensus.cc:2229] T 8bc3457ea051426681dcbd78bf10917b P 6a2e9c54bded4533bb8af6cbd022b864 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:23:51.406456 16817 raft_consensus.cc:2258] T 8bc3457ea051426681dcbd78bf10917b P 6a2e9c54bded4533bb8af6cbd022b864 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:23:51.407104 16819 ts_tablet_manager.cc:1905] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:51.408260 16818 ts_tablet_manager.cc:1905] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:23:51.409034 16819 ts_tablet_manager.cc:1918] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 03:23:51.409096 16819 log.cc:1196] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/8bc3457ea051426681dcbd78bf10917b
I20260809 03:23:51.409359 16819 ts_tablet_manager.cc:1939] T 8bc3457ea051426681dcbd78bf10917b P 5ec1f54bfdf64171a3f8768eeb10e2a0: Deleting consensus metadata
I20260809 03:23:51.409649 16227 catalog_manager.cc:4841] TS 5ec1f54bfdf64171a3f8768eeb10e2a0 (127.8.5.194:37515): tablet 8bc3457ea051426681dcbd78bf10917b (table test-table [id=1656353dc495445a9489eed0e45e7d3b]) successfully deleted
I20260809 03:23:51.410050 16818 ts_tablet_manager.cc:1918] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 03:23:51.410113 16818 log.cc:1196] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/8bc3457ea051426681dcbd78bf10917b
I20260809 03:23:51.410360 16818 ts_tablet_manager.cc:1939] T 8bc3457ea051426681dcbd78bf10917b P 551da98dbbeb4910a3869e5062a84e73: Deleting consensus metadata
I20260809 03:23:51.410668 16227 catalog_manager.cc:4841] TS 551da98dbbeb4910a3869e5062a84e73 (127.8.5.195:35507): tablet 8bc3457ea051426681dcbd78bf10917b (table test-table [id=1656353dc495445a9489eed0e45e7d3b]) successfully deleted
W20260809 03:23:51.414186 16228 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.5.193:45763 (error 108)
I20260809 03:23:51.414367 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 16466
I20260809 03:23:51.415508 16879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:51.415216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:45763 (local address 127.0.0.1:34504)
0809 03:23:51.415436 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:51.415475 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.193:45763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":83,"threads_started":1}
W20260809 03:23:51.415720 16228 catalog_manager.cc:4584] TS 6a2e9c54bded4533bb8af6cbd022b864 (127.8.5.193:45763): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8bc3457ea051426681dcbd78bf10917b: Network error: Client connection negotiation failed: client connection to 127.8.5.193:45763: connect: Connection refused (error 111)
I20260809 03:23:51.421903 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 16624
I20260809 03:23:51.428669 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 16209
2026-08-09T03:23:51Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2598 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:23:51 dist-test-slave-2w3w krb5kdc[16882](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:23:51 dist-test-slave-2w3w krb5kdc[16882](info): set up 2 sockets
Aug 09 03:23:51 dist-test-slave-2w3w krb5kdc[16882](info): commencing operation
krb5kdc: starting...
W20260809 03:23:52.496568 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:23:52 dist-test-slave-2w3w krb5kdc[16882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:23:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:23:52.617053 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:34933
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:34933
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:52.707122 16896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:52.707358 16896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:52.707401 16896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:52.708676 16896 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:52.708745 16896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:52.708773 16896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:52.708817 16896 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:52.708851 16896 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:23:52.710512 16896 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:34933
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:34933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:52.710798 16896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:52.711087 16896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:52.716254 16901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:52.716210 16904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:52.716281 16902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:52.716508 16896 server_base.cc:1034] running on GCE node
I20260809 03:23:52.716709 16896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:52.716958 16896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:52.718102 16896 hybrid_clock.cc:648] HybridClock initialized: now 1786245832718085 us; error 32 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T03:23:52Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1294 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:23:52 dist-test-slave-2w3w krb5kdc[16909](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:23:52 dist-test-slave-2w3w krb5kdc[16909](info): set up 2 sockets
Aug 09 03:23:52 dist-test-slave-2w3w krb5kdc[16909](info): commencing operation
krb5kdc: starting...
W20260809 03:23:53.808693 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:23:53 dist-test-slave-2w3w krb5kdc[16909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:23:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:23:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:23:53.937331 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:33325
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:34699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:33325
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:54.020459 16923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:54.020709 16923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:54.020746 16923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:54.021908 16923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:54.021979 16923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:54.022003 16923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:54.022024 16923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:54.022053 16923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:23:54.023569 16923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:34699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:33325
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:33325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:54.023844 16923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:54.024066 16923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:54.028733 16928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:54.028864 16932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:54.028765 16929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:54.029224 16923 server_base.cc:1034] running on GCE node
I20260809 03:23:54.029433 16923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:54.029678 16923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:54.030819 16923 hybrid_clock.cc:648] HybridClock initialized: now 1786245834030799 us; error 33 us; skew 500 ppm
Aug 09 03:23:54 dist-test-slave-2w3w krb5kdc[16909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245834, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:54.036828 16923 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:23:54.037273 16923 webserver.cc:460] Webserver started at http://127.8.5.254:40275/ using document root <none> and password file <none>
I20260809 03:23:54.037513 16923 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:54.037580 16923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:54.037726 16923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:54.038812 16923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "6987691ca87c4b45852413baedb74fb9"
format_stamp: "Formatted at 2026-08-09 03:23:54 on dist-test-slave-2w3w"
server_key: "f6ffc6690bbd33023b5234a099c5ab4c"
server_key_iv: "c441f5a67dddee3ca2175ea9737cad06"
server_key_version: "encryptionkey@0"
I20260809 03:23:54.039206 16923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "6987691ca87c4b45852413baedb74fb9"
format_stamp: "Formatted at 2026-08-09 03:23:54 on dist-test-slave-2w3w"
server_key: "f6ffc6690bbd33023b5234a099c5ab4c"
server_key_iv: "c441f5a67dddee3ca2175ea9737cad06"
server_key_version: "encryptionkey@0"
I20260809 03:23:54.040567 16923 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:54.041271 16939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:54.041435 16923 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:54.041530 16923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "6987691ca87c4b45852413baedb74fb9"
format_stamp: "Formatted at 2026-08-09 03:23:54 on dist-test-slave-2w3w"
server_key: "f6ffc6690bbd33023b5234a099c5ab4c"
server_key_iv: "c441f5a67dddee3ca2175ea9737cad06"
server_key_version: "encryptionkey@0"
I20260809 03:23:54.041605 16923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:54.061749 16923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:54.063846 16923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:54.064019 16923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:54.068181 16923 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:33325
I20260809 03:23:54.068220 16993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:33325 every 8 connection(s)
I20260809 03:23:54.068588 16923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:54.069461 16995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:23:54.071818 16995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9: Bootstrap starting.
I20260809 03:23:54.072371 16995 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9: Neither blocks nor log segments found. Creating new log.
I20260809 03:23:54.072618 16995 log.cc:824] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:54.073148 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 16923
I20260809 03:23:54.073336 16995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9: No bootstrap required, opened a new log
I20260809 03:23:54.073360 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:23:54.073542 8215 external_mini_cluster.cc:1428] Setting key dcd5ec432197192811781e8ab3ef8166
I20260809 03:23:54.075644 16995 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6987691ca87c4b45852413baedb74fb9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33325 } }
I20260809 03:23:54.075820 16995 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:23:54.075863 16995 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6987691ca87c4b45852413baedb74fb9, State: Initialized, Role: FOLLOWER
I20260809 03:23:54.076014 16995 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6987691ca87c4b45852413baedb74fb9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33325 } }
I20260809 03:23:54.076108 16995 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:54.076140 16995 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:54.076179 16995 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:23:54.076855 16995 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6987691ca87c4b45852413baedb74fb9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33325 } }
I20260809 03:23:54.076973 16995 leader_election.cc:302] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6987691ca87c4b45852413baedb74fb9; no voters:
I20260809 03:23:54.077124 16995 leader_election.cc:288] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:23:54.077206 17000 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:23:54.077342 16995 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:54.077383 17000 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [term 1 LEADER]: Becoming Leader. State: Replica: 6987691ca87c4b45852413baedb74fb9, State: Running, Role: LEADER
I20260809 03:23:54.077507 17000 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6987691ca87c4b45852413baedb74fb9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33325 } }
I20260809 03:23:54.077893 17000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6987691ca87c4b45852413baedb74fb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6987691ca87c4b45852413baedb74fb9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33325 } } }
I20260809 03:23:54.078032 17000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:54.078243 17000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6987691ca87c4b45852413baedb74fb9. Latest consensus state: current_term: 1 leader_uuid: "6987691ca87c4b45852413baedb74fb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6987691ca87c4b45852413baedb74fb9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33325 } } }
I20260809 03:23:54.078353 17000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:54.078327 17010 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:54.079061 17010 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:54.081207 17010 catalog_manager.cc:1347] Generated new cluster ID: 34bd2963f58e4728be2af435d9be41f3
I20260809 03:23:54.081269 17010 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 03:23:54 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:54.085505 16999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:54.074089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48436 (local address 127.8.5.254:33325)
0809 03:23:54.074292 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:54.074301 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:54.074334 (+ 33us) server_negotiation.cc:407] Connection header received
0809 03:23:54.074823 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:54.074831 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:54.074893 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:54.075069 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:54.075685 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.077405 (+ 1720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.078633 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.079296 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.079424 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:54.082154 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:54.082158 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:54.082159 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:54.082171 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:54.083879 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:54.084252 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:54.084255 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:54.084255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:54.084342 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:54.084551 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:54.084552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:54.084552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:54.084785 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:54.084950 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:54.085070 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 03:23:54.085212 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":86,"threads_started":1}
I20260809 03:23:54.099433 17010 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:23:54.099993 17010 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:54.103972 17010 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9: Generated new TSK 0
I20260809 03:23:54.104189 17010 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
I20260809 03:23:54.138551 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33325
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:34699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:54.241264 17022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:54.241454 17022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:54.241477 17022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:54.242548 17022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:54.242581 17022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:54.242606 17022 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:23:54.244036 17022 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:34699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:54.244258 17022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:54.244470 17022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:54.249370 17030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:54.249373 17028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:54.249372 17027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:54.249717 17022 server_base.cc:1034] running on GCE node
I20260809 03:23:54.249982 17022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:54.250211 17022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:54.251371 17022 hybrid_clock.cc:648] HybridClock initialized: now 1786245834251356 us; error 30 us; skew 500 ppm
Aug 09 03:23:54 dist-test-slave-2w3w krb5kdc[16909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245834, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:54.253861 17022 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:23:54.254279 17022 webserver.cc:460] Webserver started at http://127.8.5.193:46757/ using document root <none> and password file <none>
I20260809 03:23:54.254503 17022 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:54.254568 17022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:54.254711 17022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:54.255786 17022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "c313be681f83441f9aeffb253be0869c"
format_stamp: "Formatted at 2026-08-09 03:23:54 on dist-test-slave-2w3w"
server_key: "10bc382fb5b16f1c438e78b05a6c10dd"
server_key_iv: "aa31756bc02eded887f1a6545992ebd6"
server_key_version: "encryptionkey@0"
I20260809 03:23:54.256142 17022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "c313be681f83441f9aeffb253be0869c"
format_stamp: "Formatted at 2026-08-09 03:23:54 on dist-test-slave-2w3w"
server_key: "10bc382fb5b16f1c438e78b05a6c10dd"
server_key_iv: "aa31756bc02eded887f1a6545992ebd6"
server_key_version: "encryptionkey@0"
I20260809 03:23:54.257438 17022 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 03:23:54.258138 17037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:54.258309 17022 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:23:54.258411 17022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "c313be681f83441f9aeffb253be0869c"
format_stamp: "Formatted at 2026-08-09 03:23:54 on dist-test-slave-2w3w"
server_key: "10bc382fb5b16f1c438e78b05a6c10dd"
server_key_iv: "aa31756bc02eded887f1a6545992ebd6"
server_key_version: "encryptionkey@0"
I20260809 03:23:54.258489 17022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:54.273252 17022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:54.275573 17022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:54.275733 17022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:54.275965 17022 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:54.276279 17022 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:54.276336 17022 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:54.276427 17022 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:54.276460 17022 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:54.282224 17022 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:45939
I20260809 03:23:54.282299 17157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:45939 every 8 connection(s)
I20260809 03:23:54.282612 17022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:23:54.284927 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 17022
I20260809 03:23:54.285038 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:23:54.285256 8215 external_mini_cluster.cc:1428] Setting key 3a9612059f9b453669a4529a70463af7
Aug 09 03:23:54 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245834, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:54.293316 16999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:54.283454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:41997 (local address 127.8.5.254:33325)
0809 03:23:54.283508 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:54.283510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:54.283701 (+ 191us) server_negotiation.cc:407] Connection header received
0809 03:23:54.284191 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:54.284192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:54.284203 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:54.284273 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:54.285464 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.286190 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.287732 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.288067 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.288141 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:54.290502 (+ 2361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:54.290504 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:54.290504 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:54.290512 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:54.291940 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:54.292352 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:54.292353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:54.292354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:54.292415 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:54.292668 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:54.292669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:54.292669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:54.292785 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:54.292852 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:54.293128 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 03:23:54.293213 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 03:23:54.293505 17164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:54.283412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:41997)
0809 03:23:54.283578 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:54.283620 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:54.284085 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:54.284328 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:54.284331 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:54.285030 (+ 699us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:54.285338 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:54.285344 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.286305 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.286306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:54.287640 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:54.287644 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.288167 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.288169 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:54.288279 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:54.288797 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:54.288805 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:54.290404 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:54.292038 (+ 1634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:54.292046 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:54.292048 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:54.292276 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:54.292483 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:54.292484 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:54.292484 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:54.292594 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:54.292855 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:54.292863 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:54.292998 (+ 135us) client_negotiation.cc:769] Sending connection context
0809 03:23:54.293095 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 03:23:54.293252 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":92,"threads_started":1}
I20260809 03:23:54.294019 17162 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33325
I20260809 03:23:54.294119 17162 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:54.294296 17162 heartbeater.cc:511] Master 127.8.5.254:33325 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.5.194@KRBTEST.COM; defaulting to no policy
I20260809 03:23:54.294852 16957 ts_manager.cc:194] Registered new tserver with Master: c313be681f83441f9aeffb253be0869c (127.8.5.193:45939)
I20260809 03:23:54.295498 16957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:41997
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
I20260809 03:23:54.312166 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33325
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:34699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:54.393769 17167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:54.393993 17167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:54.394016 17167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:54.395237 17167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:54.395287 17167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:54.395314 17167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:23:54.396742 17167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:34699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:54.396987 17167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:54.397223 17167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:54.402243 17174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:54.402251 17173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:54.402252 17176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:54.402474 17167 server_base.cc:1034] running on GCE node
I20260809 03:23:54.402760 17167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:54.403043 17167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:54.404203 17167 hybrid_clock.cc:648] HybridClock initialized: now 1786245834404195 us; error 29 us; skew 500 ppm
Aug 09 03:23:54 dist-test-slave-2w3w krb5kdc[16909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245834, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:54.406661 17167 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:23:54.407167 17167 webserver.cc:460] Webserver started at http://127.8.5.194:39593/ using document root <none> and password file <none>
I20260809 03:23:54.407394 17167 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:54.407438 17167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:54.407527 17167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:54.408486 17167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "ab6d6496b02140859dbbf9c6c636f883"
format_stamp: "Formatted at 2026-08-09 03:23:54 on dist-test-slave-2w3w"
server_key: "f2f2d9aafa1778527948878e5fbecffb"
server_key_iv: "c2043b54fc86520b06f90850cc091257"
server_key_version: "encryptionkey@0"
I20260809 03:23:54.408783 17167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "ab6d6496b02140859dbbf9c6c636f883"
format_stamp: "Formatted at 2026-08-09 03:23:54 on dist-test-slave-2w3w"
server_key: "f2f2d9aafa1778527948878e5fbecffb"
server_key_iv: "c2043b54fc86520b06f90850cc091257"
server_key_version: "encryptionkey@0"
I20260809 03:23:54.410036 17167 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:23:54.410727 17183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:54.410929 17167 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:54.411052 17167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "ab6d6496b02140859dbbf9c6c636f883"
format_stamp: "Formatted at 2026-08-09 03:23:54 on dist-test-slave-2w3w"
server_key: "f2f2d9aafa1778527948878e5fbecffb"
server_key_iv: "c2043b54fc86520b06f90850cc091257"
server_key_version: "encryptionkey@0"
I20260809 03:23:54.411110 17167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:54.440485 17167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:54.442421 17167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:54.442533 17167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:54.442734 17167 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:54.443120 17167 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:54.443157 17167 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:54.443195 17167 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:54.443223 17167 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:54.449294 17167 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:39927
I20260809 03:23:54.449337 17301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:39927 every 8 connection(s)
I20260809 03:23:54.449636 17167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
Aug 09 03:23:54 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245834, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:54.458057 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 17167
I20260809 03:23:54.458182 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:23:54.458415 8215 external_mini_cluster.cc:1428] Setting key d8d8f380d03d52785362ada47594e5d1
I20260809 03:23:54.458568 16999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:54.450325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:55063 (local address 127.8.5.254:33325)
0809 03:23:54.450384 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:54.450387 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:54.450560 (+ 173us) server_negotiation.cc:407] Connection header received
0809 03:23:54.451125 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:54.451126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:54.451140 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:54.451204 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:54.452154 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.452672 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.453669 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.453871 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.453957 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:54.456101 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:54.456102 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:54.456103 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:54.456110 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:54.457240 (+ 1130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:54.457595 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:54.457596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:54.457596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:54.457644 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:54.457842 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:54.457842 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:54.457843 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:54.458004 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:54.458074 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:54.458391 (+ 317us) server_negotiation.cc:299] Negotiation successful
0809 03:23:54.458479 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 03:23:54.458758 17304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:54.450285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:55063)
0809 03:23:54.450427 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:54.450475 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:54.451016 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:54.451273 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:54.451277 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:54.451855 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:54.452047 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:54.452052 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.452768 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.452769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:54.453575 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:54.453577 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.453968 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.453969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:54.454097 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:54.454597 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:54.454606 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:54.456013 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:54.457310 (+ 1297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:54.457316 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:54.457318 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:54.457535 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:54.457698 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:54.457698 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:54.457699 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:54.457791 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:54.458075 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:54.458080 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:54.458253 (+ 173us) client_negotiation.cc:769] Sending connection context
0809 03:23:54.458356 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 03:23:54.458502 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":64,"threads_started":1}
I20260809 03:23:54.459362 17302 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33325
I20260809 03:23:54.459467 17302 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:54.459656 17302 heartbeater.cc:511] Master 127.8.5.254:33325 requested a full tablet report, sending...
I20260809 03:23:54.460019 16957 ts_manager.cc:194] Registered new tserver with Master: ab6d6496b02140859dbbf9c6c636f883 (127.8.5.194:39927)
I20260809 03:23:54.460405 16957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:55063
WARNING: no policy specified for kudu/127.8.5.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
I20260809 03:23:54.483776 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33325
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:34699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:54.564710 17307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:54.564919 17307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:54.564958 17307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:54.566114 17307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:54.566156 17307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:54.566182 17307 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:23:54.567678 17307 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:34699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:54.567925 17307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:54.568159 17307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:54.572913 17312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:54.572902 17315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:54.572928 17313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:54.573323 17307 server_base.cc:1034] running on GCE node
I20260809 03:23:54.573616 17307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:54.573864 17307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:54.575037 17307 hybrid_clock.cc:648] HybridClock initialized: now 1786245834575015 us; error 38 us; skew 500 ppm
Aug 09 03:23:54 dist-test-slave-2w3w krb5kdc[16909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245834, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:54.577765 17307 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:23:54.578323 17307 webserver.cc:460] Webserver started at http://127.8.5.195:37333/ using document root <none> and password file <none>
I20260809 03:23:54.578570 17307 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:54.578641 17307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:54.578787 17307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:23:54.580086 17307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "56c85bb5e7c042558f52a8f324a4a4ee"
format_stamp: "Formatted at 2026-08-09 03:23:54 on dist-test-slave-2w3w"
server_key: "223298c02a8946e27c0ade35304e1935"
server_key_iv: "e2a75341d4f4ae5ae989d210e05fabf5"
server_key_version: "encryptionkey@0"
I20260809 03:23:54.580477 17307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "56c85bb5e7c042558f52a8f324a4a4ee"
format_stamp: "Formatted at 2026-08-09 03:23:54 on dist-test-slave-2w3w"
server_key: "223298c02a8946e27c0ade35304e1935"
server_key_iv: "e2a75341d4f4ae5ae989d210e05fabf5"
server_key_version: "encryptionkey@0"
I20260809 03:23:54.581947 17307 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:23:54.582690 17323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:54.582870 17307 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:54.583001 17307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "56c85bb5e7c042558f52a8f324a4a4ee"
format_stamp: "Formatted at 2026-08-09 03:23:54 on dist-test-slave-2w3w"
server_key: "223298c02a8946e27c0ade35304e1935"
server_key_iv: "e2a75341d4f4ae5ae989d210e05fabf5"
server_key_version: "encryptionkey@0"
I20260809 03:23:54.583089 17307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:54.598573 17307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:54.600744 17307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:54.600915 17307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:54.601145 17307 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:54.601464 17307 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:54.601516 17307 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:54.601559 17307 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:54.601596 17307 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:54.607518 17307 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:40055
I20260809 03:23:54.607559 17444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:40055 every 8 connection(s)
I20260809 03:23:54.607916 17307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:23:54.608615 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 17307
I20260809 03:23:54.608702 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:23:54.608891 8215 external_mini_cluster.cc:1428] Setting key 0818b2ea00a36cc85620f41f1a64331f
Aug 09 03:23:54 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245834, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:23:54.617244 16999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:54.608662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:35103 (local address 127.8.5.254:33325)
0809 03:23:54.608732 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:54.608735 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:54.608992 (+ 257us) server_negotiation.cc:407] Connection header received
0809 03:23:54.609571 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:54.609572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:54.609584 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:54.609638 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:54.610644 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.611215 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.612165 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.612364 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.612423 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:54.614660 (+ 2237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:54.614661 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:54.614662 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:54.614668 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:54.616094 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:54.616452 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:54.616453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:54.616454 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:54.616506 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:54.616721 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:54.616722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:54.616723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:54.616824 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:54.616876 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:54.617114 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 03:23:54.617176 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 03:23:54.617446 17447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:54.608631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.195:35103)
0809 03:23:54.608830 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:54.608879 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:54.609481 (+ 602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:54.609728 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:54.609731 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:54.610360 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:54.610558 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:54.610563 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.611300 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.611301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:54.612095 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:54.612097 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.612449 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.612449 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:54.612553 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:54.613087 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:54.613096 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:54.614579 (+ 1483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:23:54.616163 (+ 1584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:54.616169 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:54.616171 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:54.616389 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:54.616565 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:23:54.616565 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:23:54.616566 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:23:54.616668 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:23:54.616876 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:23:54.616880 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:23:54.617001 (+ 121us) client_negotiation.cc:769] Sending connection context
0809 03:23:54.617091 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 03:23:54.617221 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":103,"threads_started":1}
I20260809 03:23:54.617959 17445 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33325
I20260809 03:23:54.618072 17445 heartbeater.cc:464] Registering TS with master...
I20260809 03:23:54.618253 17445 heartbeater.cc:511] Master 127.8.5.254:33325 requested a full tablet report, sending...
I20260809 03:23:54.618661 16957 ts_manager.cc:194] Registered new tserver with Master: 56c85bb5e7c042558f52a8f324a4a4ee (127.8.5.195:40055)
I20260809 03:23:54.619079 16957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:35103
I20260809 03:23:54.620509 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.193.keytab.
Entry for principal oryx/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.193.keytab.
WARNING: no policy specified for oryx/127.8.5.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.194.keytab.
Entry for principal oryx/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.194.keytab.
WARNING: no policy specified for oryx/127.8.5.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.195.keytab.
Entry for principal oryx/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.195.keytab.
I20260809 03:23:54.695618 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 17022
I20260809 03:23:54.702360 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 17167
I20260809 03:23:54.711920 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 17307
I20260809 03:23:54.717407 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 16923
I20260809 03:23:54.723925 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:33325
--webserver_interface=127.8.5.254
--webserver_port=40275
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:34699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:33325
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:23:54.805698 17454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:54.805919 17454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:54.805941 17454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:54.807193 17454 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:23:54.807237 17454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:54.807252 17454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:54.807298 17454 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:23:54.807324 17454 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:23:54.808841 17454 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:34699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:33325
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:33325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=40275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:54.809099 17454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:54.809336 17454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:54.814388 17463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:54.814373 17461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:54.814373 17454 server_base.cc:1034] running on GCE node
W20260809 03:23:54.814352 17460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:54.814934 17454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:54.815336 17454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:54.816498 17454 hybrid_clock.cc:648] HybridClock initialized: now 1786245834816476 us; error 38 us; skew 500 ppm
Aug 09 03:23:54 dist-test-slave-2w3w krb5kdc[16909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245834, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:54.819200 17454 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:23:54.819718 17454 webserver.cc:460] Webserver started at http://127.8.5.254:40275/ using document root <none> and password file <none>
I20260809 03:23:54.819979 17454 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:54.820060 17454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:54.821513 17454 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 03:23:54.822244 17471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:54.822433 17454 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:23:54.822542 17454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "6987691ca87c4b45852413baedb74fb9"
format_stamp: "Formatted at 2026-08-09 03:23:54 on dist-test-slave-2w3w"
server_key: "f6ffc6690bbd33023b5234a099c5ab4c"
server_key_iv: "c441f5a67dddee3ca2175ea9737cad06"
server_key_version: "encryptionkey@0"
I20260809 03:23:54.823165 17454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:54.835928 17454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:54.837741 17454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:54.837937 17454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:54.842212 17454 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:33325
I20260809 03:23:54.842674 17454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:23:54.842861 17529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:33325 every 8 connection(s)
I20260809 03:23:54.844221 17530 sys_catalog.cc:263] Verifying existing consensus state
I20260809 03:23:54.844837 17530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9: Bootstrap starting.
I20260809 03:23:54.848836 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 17454
I20260809 03:23:54.849133 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:45939
--local_ip_for_outbound_sockets=127.8.5.193
--tserver_master_addrs=127.8.5.254:33325
--webserver_port=46757
--webserver_interface=127.8.5.193
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:34699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.8.5.193
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 03:23:54.854091 17530 log.cc:824] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9: Log is configured to *not* fsync() on all Append() calls
I20260809 03:23:54.855994 17530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 03:23:54.856287 17530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9: Bootstrap complete.
I20260809 03:23:54.858661 17530 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6987691ca87c4b45852413baedb74fb9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33325 } }
I20260809 03:23:54.858922 17530 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6987691ca87c4b45852413baedb74fb9, State: Initialized, Role: FOLLOWER
I20260809 03:23:54.859145 17530 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6987691ca87c4b45852413baedb74fb9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33325 } }
I20260809 03:23:54.859246 17530 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:23:54.859304 17530 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:23:54.859354 17530 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [term 1 FOLLOWER]: Advancing to term 2
I20260809 03:23:54.860387 17530 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6987691ca87c4b45852413baedb74fb9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33325 } }
I20260809 03:23:54.860523 17530 leader_election.cc:302] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6987691ca87c4b45852413baedb74fb9; no voters:
I20260809 03:23:54.860721 17530 leader_election.cc:288] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 03:23:54.860782 17535 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 03:23:54.860945 17535 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [term 2 LEADER]: Becoming Leader. State: Replica: 6987691ca87c4b45852413baedb74fb9, State: Running, Role: LEADER
I20260809 03:23:54.861011 17530 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:23:54.861040 17535 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6987691ca87c4b45852413baedb74fb9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33325 } }
I20260809 03:23:54.861297 17535 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6987691ca87c4b45852413baedb74fb9. Latest consensus state: current_term: 2 leader_uuid: "6987691ca87c4b45852413baedb74fb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6987691ca87c4b45852413baedb74fb9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33325 } } }
I20260809 03:23:54.861369 17535 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:54.861300 17536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6987691ca87c4b45852413baedb74fb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6987691ca87c4b45852413baedb74fb9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33325 } } }
I20260809 03:23:54.861574 17536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9 [sys.catalog]: This master's current role is: LEADER
I20260809 03:23:54.861675 17540 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:23:54.862149 17540 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:23:54.862288 17540 catalog_manager.cc:1259] Loaded cluster ID: 34bd2963f58e4728be2af435d9be41f3
I20260809 03:23:54.862324 17540 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:23:54.863564 17540 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:23:54.863752 17540 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6987691ca87c4b45852413baedb74fb9: Loaded TSK: 0
I20260809 03:23:54.863965 17540 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 03:23:54.933360 17532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:54.933561 17532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:54.933585 17532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:54.934768 17532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:54.934813 17532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:54.934840 17532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:23:54.936285 17532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:34699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.193.keytab
--principal=oryx/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:45939
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=46757
--tserver_master_addrs=127.8.5.254:33325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:54.936517 17532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:54.936751 17532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:54.941726 17562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:54.941767 17559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:54.941767 17560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:54.941970 17532 server_base.cc:1034] running on GCE node
I20260809 03:23:54.942250 17532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:54.942492 17532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:54.943645 17532 hybrid_clock.cc:648] HybridClock initialized: now 1786245834943632 us; error 31 us; skew 500 ppm
Aug 09 03:23:54 dist-test-slave-2w3w krb5kdc[16909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245834, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:54.946202 17532 init.cc:377] Logged in from keytab as oryx/127.8.5.193@KRBTEST.COM (short username oryx)
I20260809 03:23:54.946689 17532 webserver.cc:460] Webserver started at http://127.8.5.193:46757/ using document root <none> and password file <none>
I20260809 03:23:54.946918 17532 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:54.947011 17532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:54.948553 17532 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:54.949205 17570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:54.949363 17532 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:54.949440 17532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "c313be681f83441f9aeffb253be0869c"
format_stamp: "Formatted at 2026-08-09 03:23:54 on dist-test-slave-2w3w"
server_key: "10bc382fb5b16f1c438e78b05a6c10dd"
server_key_iv: "aa31756bc02eded887f1a6545992ebd6"
server_key_version: "encryptionkey@0"
I20260809 03:23:54.949787 17532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:54.966243 17532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:54.968662 17532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:54.968813 17532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:54.969101 17532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:54.969442 17532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:54.969477 17532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:54.969499 17532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:54.969538 17532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:54.976980 17532 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:45939
I20260809 03:23:54.977146 17691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:45939 every 8 connection(s)
I20260809 03:23:54.977444 17532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:23:54.984982 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 17532
Aug 09 03:23:54 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:54.985311 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:39927
--local_ip_for_outbound_sockets=127.8.5.194
--tserver_master_addrs=127.8.5.254:33325
--webserver_port=39593
--webserver_interface=127.8.5.194
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:34699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.8.5.194
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 03:23:54 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:54.987264 17694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:54.978156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:44381)
0809 03:23:54.978363 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:54.978415 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:54.979077 (+ 662us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:54.979501 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:54.979506 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:54.980263 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:54.980535 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:54.980541 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.981617 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.981618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:54.982850 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:54.982853 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.983489 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.983490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:54.983639 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:54.984180 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:54.984190 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:54.987052 (+ 2862us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":93,"threads_started":1}
W20260809 03:23:54.987468 17696 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:54.978274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:44381 (local address 127.8.5.254:33325)
0809 03:23:54.978457 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:54.978471 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:54.978503 (+ 32us) server_negotiation.cc:407] Connection header received
0809 03:23:54.979261 (+ 758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:54.979267 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:54.979310 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:54.979422 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:54.980647 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.981524 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.982934 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.983383 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.983473 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:54.987282 (+ 3809us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.193:44381: BlockingRecv error: recv got EOF from 127.8.5.193:44381 (error 108)
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":77,"threads_started":1}
W20260809 03:23:54.987519 17692 heartbeater.cc:644] Failed to heartbeat to 127.8.5.254:33325 (0 consecutive failures): Not authorized: Failed to ping master at 127.8.5.254:33325: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Aug 09 03:23:54 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:54 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:54.992303 17694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:54.987752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:52279)
0809 03:23:54.987890 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:54.987902 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:54.987976 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:54.988118 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:54.988118 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:54.988248 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:54.988292 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:54.988294 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.988932 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.988933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:54.989445 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:54.989447 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.989812 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.989813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:54.989880 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:54.990298 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:54.990303 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:54.992215 (+ 1912us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":79,"threads_started":1}
W20260809 03:23:54.992367 17696 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:54.987790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:52279 (local address 127.8.5.254:33325)
0809 03:23:54.987827 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:54.987829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:54.987962 (+ 133us) server_negotiation.cc:407] Connection header received
0809 03:23:54.988044 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:54.988045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:54.988057 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:54.988114 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:54.988382 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.988851 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.989540 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.989731 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.989810 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:54.992291 (+ 2481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.193:52279: BlockingRecv error: recv got EOF from 127.8.5.193:52279 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Aug 09 03:23:54 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:54 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:54.996989 17698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:54.992560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:52071)
0809 03:23:54.992611 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:54.992621 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:54.992658 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:54.992790 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:54.992790 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:54.992943 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:54.992985 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:54.992986 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.993589 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.993590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:54.994161 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:54.994163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.994528 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.994529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:54.994585 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:54.995044 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:54.995048 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:54.996889 (+ 1841us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 03:23:54.997008 17696 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:54.992605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:52071 (local address 127.8.5.254:33325)
0809 03:23:54.992642 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:54.992643 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:54.992665 (+ 22us) server_negotiation.cc:407] Connection header received
0809 03:23:54.992721 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:54.992722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:54.992732 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:54.992775 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:54.993056 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.993510 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.994248 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:54.994439 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:54.994510 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:54.996966 (+ 2456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.193:52071: BlockingRecv error: recv got EOF from 127.8.5.193:52071 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 03:23:54.997263 17692 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 03:23:55.071066 17697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:55.071265 17697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:55.071290 17697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:55.072499 17697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:55.072539 17697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:55.072587 17697 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:23:55.073976 17697 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:34699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.194.keytab
--principal=oryx/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:39927
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=39593
--tserver_master_addrs=127.8.5.254:33325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:55.074209 17697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:55.074435 17697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:55.079387 17703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:55.079402 17704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:55.079481 17697 server_base.cc:1034] running on GCE node
W20260809 03:23:55.079408 17706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:55.079900 17697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:55.080176 17697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:55.081331 17697 hybrid_clock.cc:648] HybridClock initialized: now 1786245835081321 us; error 36 us; skew 500 ppm
Aug 09 03:23:55 dist-test-slave-2w3w krb5kdc[16909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245835, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:55.083844 17697 init.cc:377] Logged in from keytab as oryx/127.8.5.194@KRBTEST.COM (short username oryx)
I20260809 03:23:55.084255 17697 webserver.cc:460] Webserver started at http://127.8.5.194:39593/ using document root <none> and password file <none>
I20260809 03:23:55.084473 17697 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:55.084554 17697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:55.085862 17697 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:55.086424 17713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:55.086601 17697 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:23:55.086691 17697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "ab6d6496b02140859dbbf9c6c636f883"
format_stamp: "Formatted at 2026-08-09 03:23:54 on dist-test-slave-2w3w"
server_key: "f2f2d9aafa1778527948878e5fbecffb"
server_key_iv: "c2043b54fc86520b06f90850cc091257"
server_key_version: "encryptionkey@0"
I20260809 03:23:55.087090 17697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:55.100567 17697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:55.103046 17697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:55.103201 17697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:55.103420 17697 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:55.103724 17697 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:55.103755 17697 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:55.103801 17697 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:55.103828 17697 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:55.109527 17697 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:39927
I20260809 03:23:55.109606 17833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:39927 every 8 connection(s)
I20260809 03:23:55.109952 17697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:23:55.111150 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 17697
I20260809 03:23:55.111428 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:40055
--local_ip_for_outbound_sockets=127.8.5.195
--tserver_master_addrs=127.8.5.254:33325
--webserver_port=37333
--webserver_interface=127.8.5.195
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:34699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.8.5.195
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 03:23:55 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:55 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 03:23:55.118366 17696 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:55.110685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:48637 (local address 127.8.5.254:33325)
0809 03:23:55.110756 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:55.110759 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:55.111033 (+ 274us) server_negotiation.cc:407] Connection header received
0809 03:23:55.111624 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:55.111626 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:55.111643 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:55.111678 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:55.112666 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.113355 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.114658 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.115014 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.115091 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:55.118313 (+ 3222us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.194:48637: BlockingRecv error: recv got EOF from 127.8.5.194:48637 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 03:23:55.118490 17836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:55.110661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:48637)
0809 03:23:55.110861 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:55.110896 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:55.111481 (+ 585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:55.111827 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:55.111830 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:55.112386 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:55.112569 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:55.112573 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.113453 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.113454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:55.114568 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:55.114571 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.115120 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.115122 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:55.115240 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:55.115785 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:55.115793 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:55.118233 (+ 2440us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":112,"threads_started":1}
W20260809 03:23:55.118741 17834 heartbeater.cc:644] Failed to heartbeat to 127.8.5.254:33325 (0 consecutive failures): Not authorized: Failed to ping master at 127.8.5.254:33325: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Aug 09 03:23:55 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:55 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:55.123629 17838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:55.118991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:47209)
0809 03:23:55.119141 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:55.119151 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:55.119217 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:55.119348 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:55.119349 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:55.119496 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:55.119538 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:55.119539 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.120171 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.120172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:55.120695 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:55.120697 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.121076 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.121078 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:55.121138 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:55.121591 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:55.121596 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:55.123531 (+ 1935us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":82,"threads_started":1}
W20260809 03:23:55.123672 17696 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:55.119014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:47209 (local address 127.8.5.254:33325)
0809 03:23:55.119054 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:55.119055 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:55.119202 (+ 147us) server_negotiation.cc:407] Connection header received
0809 03:23:55.119278 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:55.119279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:55.119289 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:55.119340 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:55.119622 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.120095 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.120776 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.120972 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.121051 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:55.123605 (+ 2554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.194:47209: BlockingRecv error: recv got EOF from 127.8.5.194:47209 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
Aug 09 03:23:55 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:55 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:55.128284 17838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:55.123929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:59685)
0809 03:23:55.124029 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:55.124039 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:55.124083 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:55.124208 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:55.124209 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:55.124335 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:55.124381 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:55.124382 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.124972 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.124973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:55.125481 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:55.125483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.125888 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.125889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:55.125961 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:55.126373 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:55.126377 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:55.128212 (+ 1835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":85}
W20260809 03:23:55.128360 17696 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:55.123979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:59685 (local address 127.8.5.254:33325)
0809 03:23:55.124025 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:55.124027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:55.124070 (+ 43us) server_negotiation.cc:407] Connection header received
0809 03:23:55.124139 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:55.124140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:55.124149 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:55.124203 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:55.124451 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.124896 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.125574 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.125833 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.125890 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:55.128289 (+ 2399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.194:59685: BlockingRecv error: recv got EOF from 127.8.5.194:59685 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260809 03:23:55.128583 17834 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 03:23:55.204411 17837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:23:55.204681 17837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:23:55.204713 17837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:23:55.206435 17837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:23:55.206477 17837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:23:55.206516 17837 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:23:55.208652 17837 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:34699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/krb5kdc/oryx_127.8.5.195.keytab
--principal=oryx/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:40055
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=37333
--tserver_master_addrs=127.8.5.254:33325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:23:55.208896 17837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:23:55.209144 17837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:23:55.214787 17844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:55.214788 17846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:23:55.214841 17843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:23:55.214996 17837 server_base.cc:1034] running on GCE node
I20260809 03:23:55.215337 17837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:23:55.215626 17837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:23:55.216773 17837 hybrid_clock.cc:648] HybridClock initialized: now 1786245835216759 us; error 32 us; skew 500 ppm
Aug 09 03:23:55 dist-test-slave-2w3w krb5kdc[16909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245835, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:23:55.219676 17837 init.cc:377] Logged in from keytab as oryx/127.8.5.195@KRBTEST.COM (short username oryx)
I20260809 03:23:55.220227 17837 webserver.cc:460] Webserver started at http://127.8.5.195:37333/ using document root <none> and password file <none>
I20260809 03:23:55.220507 17837 fs_manager.cc:359] Metadata directory not provided
I20260809 03:23:55.220589 17837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:23:55.222034 17837 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:23:55.222648 17853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:55.222839 17837 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:55.222939 17837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "56c85bb5e7c042558f52a8f324a4a4ee"
format_stamp: "Formatted at 2026-08-09 03:23:54 on dist-test-slave-2w3w"
server_key: "223298c02a8946e27c0ade35304e1935"
server_key_iv: "e2a75341d4f4ae5ae989d210e05fabf5"
server_key_version: "encryptionkey@0"
I20260809 03:23:55.223326 17837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:23:55.238224 17837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:23:55.240820 17837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:23:55.240985 17837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:23:55.241235 17837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:23:55.241571 17837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:23:55.241626 17837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:55.241663 17837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:23:55.241695 17837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:23:55.248236 17837 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:40055
I20260809 03:23:55.248324 17972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:40055 every 8 connection(s)
I20260809 03:23:55.248700 17837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:23:55.250140 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 17837
Aug 09 03:23:55 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:55 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 03:23:55.257755 17696 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:55.249609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:48951 (local address 127.8.5.254:33325)
0809 03:23:55.249675 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:55.249678 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:55.249901 (+ 223us) server_negotiation.cc:407] Connection header received
0809 03:23:55.250478 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:55.250480 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:55.250494 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:55.250542 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:55.251839 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.252318 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.253693 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.254017 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.254118 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:55.257692 (+ 3574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.195:48951: BlockingRecv error: recv got EOF from 127.8.5.195:48951 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 03:23:55.257774 17975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:55.249607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.195:48951)
0809 03:23:55.249770 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:55.249816 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:55.250369 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:55.250636 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:55.250640 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:55.251485 (+ 845us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:55.251763 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:55.251770 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.252433 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.252434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:55.253598 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:55.253602 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.254141 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.254143 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:55.254264 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:55.254771 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:55.254780 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:55.257602 (+ 2822us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":85,"threads_started":1}
W20260809 03:23:55.258108 17973 heartbeater.cc:644] Failed to heartbeat to 127.8.5.254:33325 (0 consecutive failures): Not authorized: Failed to ping master at 127.8.5.254:33325: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
I20260809 03:23:55.258481 17977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:55.250679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48440 (local address 127.8.5.254:33325)
0809 03:23:55.250792 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:55.250794 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:55.250804 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:23:55.250893 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:55.250894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:55.250903 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:55.251011 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:55.251759 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.252302 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.253139 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.253488 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.253569 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:55.254953 (+ 1384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:23:55.254987 (+ 34us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:23:55.254988 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:23:55.255000 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:23:55.256840 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:55.257282 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:55.257284 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:55.257285 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:55.257379 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:23:55.257610 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:23:55.257610 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:23:55.257611 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:23:55.257947 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:23:55.258106 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 03:23:55.258234 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 03:23:55.258351 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":71,"threads_started":1}
Aug 09 03:23:55 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:55 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:55.263217 17975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:55.258360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.195:40617)
0809 03:23:55.258405 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:55.258416 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:55.258458 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:55.258773 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:55.258774 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:55.258889 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:55.258959 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:55.258961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.259940 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.259941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:55.260429 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:55.260430 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.260799 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.260800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:55.260862 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:55.261396 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:55.261400 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:55.263170 (+ 1770us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 03:23:55.263361 17696 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:55.258392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:40617 (local address 127.8.5.254:33325)
0809 03:23:55.258432 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:55.258434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:55.258444 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:23:55.258512 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:55.258513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:55.258523 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:55.258584 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:55.259071 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.259732 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.260501 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.260684 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.260734 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:55.263268 (+ 2534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.195:40617: BlockingRecv error: recv got EOF from 127.8.5.195:40617 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 09 03:23:55 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:55 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:55.267254 17975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:55.263509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.195:33835)
0809 03:23:55.263541 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:55.263554 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:55.263596 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:55.263716 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:55.263716 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:55.263840 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:55.263865 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:55.263867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.264447 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.264448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:55.264983 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:55.264985 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.265309 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.265310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:55.265350 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:55.265676 (+ 326us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:55.265680 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:55.267212 (+ 1532us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":16}
W20260809 03:23:55.267357 17696 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:55.263579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:33835 (local address 127.8.5.254:33325)
0809 03:23:55.263630 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:55.263631 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:55.263638 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:23:55.263656 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:55.263657 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:55.263664 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:55.263714 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:55.263921 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.264381 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.265049 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.265229 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.265280 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:55.267289 (+ 2009us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.195:33835: BlockingRecv error: recv got EOF from 127.8.5.195:33835 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260809 03:23:55.267380 17973 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 03:23:55 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:55 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:56.002441 17978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:55.997643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:42575)
0809 03:23:55.997798 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:55.997811 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:55.997865 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:55.998089 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:55.998090 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:55.998265 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:55.998315 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:55.998316 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.999018 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.999019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:55.999564 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:55.999565 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.999910 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.999910 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:55.999971 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:56.000583 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:56.000589 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:56.002381 (+ 1792us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":76,"threads_started":1}
W20260809 03:23:56.002548 17979 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:55.997832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:42575 (local address 127.8.5.254:33325)
0809 03:23:55.997969 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:55.997970 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:55.997978 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:23:55.998000 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:55.998000 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:55.998009 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:55.998074 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:55.998376 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.998898 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.999634 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:55.999837 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:55.999897 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:56.002474 (+ 2577us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.193:42575: BlockingRecv error: recv got EOF from 127.8.5.193:42575 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":78,"threads_started":1}
Aug 09 03:23:56 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:56 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:56.133496 17980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:56.128951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:59915)
0809 03:23:56.129115 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:56.129126 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:56.129214 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:56.129376 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:56.129377 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:56.129593 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:56.129648 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:56.129650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:56.130284 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:56.130285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:56.130835 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:56.130836 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:56.131183 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:56.131185 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:56.131234 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:56.131740 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:56.131745 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:56.133425 (+ 1680us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":83,"threads_started":1}
W20260809 03:23:56.133561 17979 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:56.129072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:59915 (local address 127.8.5.254:33325)
0809 03:23:56.129123 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:56.129125 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:56.129222 (+ 97us) server_negotiation.cc:407] Connection header received
0809 03:23:56.129279 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:56.129280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:56.129295 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:56.129359 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:56.129715 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:56.130212 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:56.130917 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:56.131115 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:56.131169 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:56.133515 (+ 2346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.194:59915: BlockingRecv error: recv got EOF from 127.8.5.194:59915 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 09 03:23:56 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:56 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:56.272578 17981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:56.267819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.195:54461)
0809 03:23:56.267960 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:56.267971 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:56.268031 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:56.268322 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:56.268323 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:56.268557 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:56.268616 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:56.268619 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:56.269297 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:56.269297 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:56.269860 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:56.269861 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:56.270165 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:56.270165 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:56.270204 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:56.270625 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:56.270630 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:56.272470 (+ 1840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":82,"threads_started":1}
W20260809 03:23:56.272622 17979 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:56.267907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:54461 (local address 127.8.5.254:33325)
0809 03:23:56.268006 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:56.268008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:56.268021 (+ 13us) server_negotiation.cc:407] Connection header received
0809 03:23:56.268209 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:56.268210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:56.268225 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:56.268292 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:56.268696 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:56.269231 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:56.269929 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:56.270109 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:56.270157 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:56.272556 (+ 2399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.195:54461: BlockingRecv error: recv got EOF from 127.8.5.195:54461 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 03:23:56 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:57 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:57.007556 17982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:57.002952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:38605)
0809 03:23:57.003105 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:57.003115 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:57.003165 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:57.003301 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:57.003301 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:57.003465 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:57.003517 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:57.003518 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:57.004148 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:57.004149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:57.004677 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:57.004678 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:57.005031 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:57.005032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:57.005079 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:57.005525 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:57.005530 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:57.007449 (+ 1919us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":95,"threads_started":1}
W20260809 03:23:57.007666 17983 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:57.003039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:38605 (local address 127.8.5.254:33325)
0809 03:23:57.003166 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:57.003168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:57.003198 (+ 30us) server_negotiation.cc:407] Connection header received
0809 03:23:57.003219 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:57.003220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:57.003229 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:57.003278 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:57.003582 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:57.004083 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:57.004747 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:57.004958 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:57.005011 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:57.007563 (+ 2552us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.193:38605: BlockingRecv error: recv got EOF from 127.8.5.193:38605 (error 108)
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":73,"threads_started":1}
Aug 09 03:23:57 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:57 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:57.138860 17984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:57.133970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:46301)
0809 03:23:57.134143 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:57.134153 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:57.134222 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:57.134391 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:57.134392 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:57.134573 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:57.134619 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:57.134621 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:57.135389 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:57.135390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:57.136148 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:57.136151 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:57.136490 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:57.136491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:57.136550 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:57.137034 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:57.137040 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:57.138797 (+ 1757us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":87,"threads_started":1}
W20260809 03:23:57.139025 17983 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:57.134027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:46301 (local address 127.8.5.254:33325)
0809 03:23:57.134094 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:57.134096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:57.134207 (+ 111us) server_negotiation.cc:407] Connection header received
0809 03:23:57.134281 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:57.134282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:57.134303 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:57.134368 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:57.134694 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:57.135286 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:57.136231 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:57.136424 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:57.136493 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:57.138909 (+ 2416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.194:46301: BlockingRecv error: recv got EOF from 127.8.5.194:46301 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 09 03:23:57 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:57 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:57.277617 17985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:57.273061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.195:37503)
0809 03:23:57.273203 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:57.273214 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:57.273263 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:57.273381 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:57.273381 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:57.273546 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:57.273595 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:57.273596 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:57.274224 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:57.274224 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:57.274797 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:57.274800 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:57.275309 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:57.275310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:57.275378 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:57.275874 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:57.275879 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:57.277560 (+ 1681us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":96,"threads_started":1}
W20260809 03:23:57.277742 17983 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:57.273187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:37503 (local address 127.8.5.254:33325)
0809 03:23:57.273237 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:57.273239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:57.273251 (+ 12us) server_negotiation.cc:407] Connection header received
0809 03:23:57.273312 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:57.273312 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:57.273324 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:57.273369 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:57.273651 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:57.274162 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:57.274906 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:57.275229 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:57.275293 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:57.277645 (+ 2352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.195:37503: BlockingRecv error: recv got EOF from 127.8.5.195:37503 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 09 03:23:58 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:58 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:58.012974 17986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:58.008040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:50525)
0809 03:23:58.008205 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:58.008216 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:58.008280 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:58.008417 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:58.008418 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:58.008587 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:58.008640 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:58.008641 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:58.009627 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:58.009628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:58.010153 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:58.010154 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:58.010511 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:58.010512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:58.010556 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:58.011123 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:58.011128 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:58.012913 (+ 1785us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":86,"threads_started":1}
W20260809 03:23:58.013154 17987 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:58.008128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:50525 (local address 127.8.5.254:33325)
0809 03:23:58.008234 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:58.008236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:58.008278 (+ 42us) server_negotiation.cc:407] Connection header received
0809 03:23:58.008334 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:58.008334 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:58.008345 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:58.008396 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:58.008736 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:58.009549 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:58.010246 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:58.010441 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:58.010499 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:58.013050 (+ 2551us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.193:50525: BlockingRecv error: recv got EOF from 127.8.5.193:50525 (error 108)
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":52,"threads_started":1}
Aug 09 03:23:58 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:58 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:58.143810 17988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:58.139332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:33933)
0809 03:23:58.139495 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:58.139505 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:58.139563 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:58.139685 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:58.139686 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:58.139864 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:58.139918 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:58.139919 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:58.140543 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:58.140544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:58.141082 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:58.141084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:58.141418 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:58.141419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:58.141473 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:58.141957 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:58.141962 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:58.143750 (+ 1788us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":90,"threads_started":1}
W20260809 03:23:58.143949 17987 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:58.139405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:33933 (local address 127.8.5.254:33325)
0809 03:23:58.139447 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:58.139449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:58.139546 (+ 97us) server_negotiation.cc:407] Connection header received
0809 03:23:58.139607 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:58.139608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:58.139618 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:58.139665 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:58.139977 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:58.140466 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:58.141151 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:58.141350 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:58.141397 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:58.143870 (+ 2473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.194:33933: BlockingRecv error: recv got EOF from 127.8.5.194:33933 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 09 03:23:58 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:58 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:58.282572 17989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:58.278173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.195:56329)
0809 03:23:58.278360 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:58.278371 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:58.278458 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:58.278601 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:58.278603 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:58.278778 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:58.278831 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:58.278833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:58.279536 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:58.279537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:58.280056 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:58.280057 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:58.280386 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:58.280387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:58.280436 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:58.280859 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:58.280863 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:58.282506 (+ 1643us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":75,"threads_started":1}
W20260809 03:23:58.282644 17987 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:58.278223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:56329 (local address 127.8.5.254:33325)
0809 03:23:58.278279 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:58.278282 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:58.278448 (+ 166us) server_negotiation.cc:407] Connection header received
0809 03:23:58.278517 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:58.278518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:58.278532 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:58.278587 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:58.278924 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:58.279472 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:58.280123 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:58.280302 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:58.280360 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:58.282595 (+ 2235us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.195:56329: BlockingRecv error: recv got EOF from 127.8.5.195:56329 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 09 03:23:59 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:59 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:59.018133 17990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:59.013447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:36399)
0809 03:23:59.013576 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:59.013587 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:59.013637 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:59.013800 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:59.013800 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:59.013969 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:59.014020 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:59.014021 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:59.014662 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:59.014663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:59.015383 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:59.015387 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:59.015759 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:59.015760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:59.015802 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:59.016272 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:59.016277 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:59.018060 (+ 1783us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":74,"threads_started":1}
W20260809 03:23:59.018235 17991 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:59.013545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:36399 (local address 127.8.5.254:33325)
0809 03:23:59.013683 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:59.013685 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:59.013692 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:23:59.013715 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:59.013716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:59.013725 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:59.013788 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:59.014088 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:59.014589 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:59.015464 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:59.015697 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:59.015752 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:59.018159 (+ 2407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.193:36399: BlockingRecv error: recv got EOF from 127.8.5.193:36399 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":82,"threads_started":1}
Aug 09 03:23:59 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:59 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:59.151871 17992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:59.144235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:45765)
0809 03:23:59.144402 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:59.144413 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:59.144475 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:59.144637 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:59.144639 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:59.144815 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:59.144868 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:59.144869 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:59.145553 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:59.145554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:59.146144 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:59.146146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:59.146479 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:59.146479 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:59.146526 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:59.150016 (+ 3490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:59.150020 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:59.151782 (+ 1762us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":74,"threads_started":1}
W20260809 03:23:59.151968 17991 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:59.144350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:45765 (local address 127.8.5.254:33325)
0809 03:23:59.144397 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:59.144399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:59.144462 (+ 63us) server_negotiation.cc:407] Connection header received
0809 03:23:59.144533 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:59.144534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:59.144544 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:59.144589 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:59.144941 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:59.145477 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:59.146228 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:59.146416 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:59.146463 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:59.151901 (+ 5438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.194:45765: BlockingRecv error: recv got EOF from 127.8.5.194:45765 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 09 03:23:59 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:23:59 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:23:59.287611 17993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:23:59.283240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.195:49821)
0809 03:23:59.283387 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 03:23:59.283399 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:23:59.283459 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:23:59.283597 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:23:59.283598 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:23:59.283757 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:23:59.283808 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:59.283809 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:59.284436 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:59.284437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:59.284945 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:23:59.284946 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:23:59.285243 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:23:59.285244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:23:59.285281 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:59.285764 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:23:59.285769 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:23:59.287555 (+ 1786us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":75,"threads_started":1}
W20260809 03:23:59.287712 17991 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:23:59.283332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:49821 (local address 127.8.5.254:33325)
0809 03:23:59.283417 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0809 03:23:59.283419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:23:59.283448 (+ 29us) server_negotiation.cc:407] Connection header received
0809 03:23:59.283510 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:23:59.283510 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:23:59.283523 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:23:59.283581 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:23:59.283871 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:59.284373 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:59.285012 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:23:59.285185 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:23:59.285233 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:23:59.287641 (+ 2408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.195:49821: BlockingRecv error: recv got EOF from 127.8.5.195:49821 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 03:24:00 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:00 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:00.023173 17994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:00.018650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:48753)
0809 03:24:00.018802 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:00.018813 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:00.018873 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:00.019057 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:00.019058 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:00.019217 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:00.019269 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:00.019270 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:00.019910 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:00.019911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:00.020457 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:00.020459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:00.020769 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:00.020770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:00.020809 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:00.021330 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:00.021335 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:00.023103 (+ 1768us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":90,"threads_started":1}
W20260809 03:24:00.023243 17995 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:00.018745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:48753 (local address 127.8.5.254:33325)
0809 03:24:00.018842 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:00.018844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:00.018857 (+ 13us) server_negotiation.cc:407] Connection header received
0809 03:24:00.018921 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:00.018922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:00.018932 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:00.019050 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:00.019341 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:00.019844 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:00.020522 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:00.020711 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:00.020759 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:00.023189 (+ 2430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.193:48753: BlockingRecv error: recv got EOF from 127.8.5.193:48753 (error 108)
Metrics: {"server-negotiator.queue_time_us":76,"thread_start_us":50,"threads_started":1}
Aug 09 03:24:00 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:00 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:00.157261 17996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:00.152348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:34449)
0809 03:24:00.152533 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:00.152548 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:00.152618 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:00.152793 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:00.152794 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:00.152966 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:00.153045 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:00.153048 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:00.153708 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:00.153709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:00.154275 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:00.154277 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:00.154626 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:00.154627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:00.154671 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:00.155274 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:00.155279 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:00.157200 (+ 1921us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":87,"threads_started":1}
W20260809 03:24:00.157416 17995 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:00.152522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:34449 (local address 127.8.5.254:33325)
0809 03:24:00.152590 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:00.152591 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:00.152599 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:24:00.152704 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:00.152705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:00.152724 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:00.152773 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:00.153131 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:00.153642 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:00.154369 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:00.154560 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:00.154614 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:00.157339 (+ 2725us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.194:34449: BlockingRecv error: recv got EOF from 127.8.5.194:34449 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 03:24:00 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:00 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:00.292479 17997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:00.288041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.195:49203)
0809 03:24:00.288172 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:00.288183 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:00.288252 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:00.288382 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:00.288383 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:00.288543 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:00.288594 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:00.288596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:00.289265 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:00.289266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:00.289808 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:00.289828 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:00.290145 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:00.290145 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:00.290185 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:00.290599 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:00.290605 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:00.292409 (+ 1804us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":81,"threads_started":1}
W20260809 03:24:00.292594 17995 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:00.288099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:49203 (local address 127.8.5.254:33325)
0809 03:24:00.288144 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:00.288146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:00.288234 (+ 88us) server_negotiation.cc:407] Connection header received
0809 03:24:00.288294 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:00.288294 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:00.288307 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:00.288372 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:00.288650 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:00.289200 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:00.289894 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:00.290073 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:00.290143 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:00.292494 (+ 2351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.195:49203: BlockingRecv error: recv got EOF from 127.8.5.195:49203 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 09 03:24:01 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:01 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:01.028317 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:01.023645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:51723)
0809 03:24:01.023821 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:01.023836 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:01.023909 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:01.024061 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:01.024062 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:01.024225 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:01.024275 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:01.024276 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:01.024933 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:01.024933 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:01.025459 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:01.025460 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:01.025900 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:01.025901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:01.025987 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:01.026441 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:01.026446 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:01.028256 (+ 1810us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":74,"threads_started":1}
W20260809 03:24:01.028467 17999 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:01.023757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:51723 (local address 127.8.5.254:33325)
0809 03:24:01.023888 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:01.023890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:01.023898 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:24:01.023973 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:01.023974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:01.023984 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:01.024041 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:01.024335 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:01.024861 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:01.025539 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:01.025778 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:01.025875 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:01.028351 (+ 2476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.193:51723: BlockingRecv error: recv got EOF from 127.8.5.193:51723 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":73,"threads_started":1}
Aug 09 03:24:01 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:01 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:01.162743 18000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:01.157797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:54553)
0809 03:24:01.157951 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:01.157981 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:01.158050 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:01.158174 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:01.158175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:01.158337 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:01.158400 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:01.158401 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:01.159042 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:01.159043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:01.159688 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:01.159691 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:01.160019 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:01.160019 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:01.160058 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:01.160586 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:01.160591 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:01.162684 (+ 2093us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":69,"threads_started":1}
W20260809 03:24:01.162892 17999 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:01.157851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:54553 (local address 127.8.5.254:33325)
0809 03:24:01.157898 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:01.157900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:01.158043 (+ 143us) server_negotiation.cc:407] Connection header received
0809 03:24:01.158096 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:01.158097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:01.158108 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:01.158157 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:01.158462 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:01.158983 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:01.159755 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:01.159955 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:01.160011 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:01.162771 (+ 2760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.194:54553: BlockingRecv error: recv got EOF from 127.8.5.194:54553 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 09 03:24:01 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:01 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:01.297737 18001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:01.292928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.195:44515)
0809 03:24:01.293106 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:01.293121 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:01.293205 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:01.293382 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:01.293383 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:01.293563 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:01.293611 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:01.293613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:01.294286 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:01.294287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:01.294835 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:01.294836 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:01.295262 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:01.295263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:01.295321 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:01.295767 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:01.295771 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:01.297641 (+ 1870us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":98,"threads_started":1}
W20260809 03:24:01.297778 17999 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:01.293014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:44515 (local address 127.8.5.254:33325)
0809 03:24:01.293092 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:01.293095 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:01.293185 (+ 90us) server_negotiation.cc:407] Connection header received
0809 03:24:01.293261 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:01.293262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:01.293276 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:01.293344 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:01.293692 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:01.294200 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:01.294926 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:01.295174 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:01.295261 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:01.297715 (+ 2454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.195:44515: BlockingRecv error: recv got EOF from 127.8.5.195:44515 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 03:24:02 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:02 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:02.033548 18002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:02.028765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:55029)
0809 03:24:02.028916 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:02.028927 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:02.028984 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:02.029109 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:02.029109 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:02.029294 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:02.029345 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:02.029346 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:02.030166 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:02.030167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:02.030705 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:02.030707 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:02.031112 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:02.031113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:02.031156 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:02.031572 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:02.031577 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:02.033445 (+ 1868us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":88,"threads_started":1}
W20260809 03:24:02.033603 18003 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:02.028873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:55029 (local address 127.8.5.254:33325)
0809 03:24:02.028991 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:02.028993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:02.029002 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:24:02.029025 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:02.029025 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:02.029035 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:02.029092 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:02.029401 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:02.030098 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:02.030772 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:02.031041 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:02.031102 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:02.033528 (+ 2426us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.193:55029: BlockingRecv error: recv got EOF from 127.8.5.193:55029 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":69,"threads_started":1}
Aug 09 03:24:02 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:02 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:02.168157 18005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:02.163225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:36699)
0809 03:24:02.163388 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:02.163402 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:02.163466 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:02.163597 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:02.163598 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:02.163796 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:02.163850 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:02.163852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:02.164478 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:02.164478 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:02.165032 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:02.165034 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:02.165344 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:02.165345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:02.165389 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:02.165860 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:02.165865 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:02.168057 (+ 2192us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":110,"threads_started":1}
W20260809 03:24:02.168197 18003 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:02.163295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:36699 (local address 127.8.5.254:33325)
0809 03:24:02.163360 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:02.163362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:02.163465 (+ 103us) server_negotiation.cc:407] Connection header received
0809 03:24:02.163524 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:02.163525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:02.163535 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:02.163577 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:02.163914 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:02.164406 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:02.165102 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:02.165281 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:02.165328 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:02.168135 (+ 2807us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.194:36699: BlockingRecv error: recv got EOF from 127.8.5.194:36699 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 09 03:24:02 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:02 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:02.302991 18006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:02.298244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.195:46777)
0809 03:24:02.298385 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:02.298473 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:02.298551 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:02.298709 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:02.298711 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:02.299022 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:02.299074 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:02.299077 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:02.299749 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:02.299751 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:02.300282 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:02.300284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:02.300635 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:02.300636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:02.300707 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:02.301141 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:02.301145 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:02.302870 (+ 1725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":82,"threads_started":1}
W20260809 03:24:02.303028 18003 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:02.298364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:46777 (local address 127.8.5.254:33325)
0809 03:24:02.298411 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:02.298413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:02.298542 (+ 129us) server_negotiation.cc:407] Connection header received
0809 03:24:02.298610 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:02.298611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:02.298628 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:02.298685 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:02.299159 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:02.299667 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:02.300373 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:02.300563 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:02.300636 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:02.302948 (+ 2312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.195:46777: BlockingRecv error: recv got EOF from 127.8.5.195:46777 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 09 03:24:03 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:03 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:03.038884 18007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:03.034006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:47465)
0809 03:24:03.034166 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:03.034178 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:03.034239 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:03.034397 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:03.034397 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:03.034564 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:03.034617 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:03.034618 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:03.035397 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:03.035399 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:03.036032 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:03.036035 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:03.036427 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:03.036429 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:03.036502 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:03.037109 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:03.037114 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:03.038824 (+ 1710us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":100,"threads_started":1}
W20260809 03:24:03.039069 18008 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:03.034136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:47465 (local address 127.8.5.254:33325)
0809 03:24:03.034276 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:03.034278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:03.034285 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:24:03.034306 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:03.034307 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:03.034316 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:03.034376 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:03.034706 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:03.035308 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:03.036136 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:03.036342 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:03.036404 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:03.038963 (+ 2559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.193:47465: BlockingRecv error: recv got EOF from 127.8.5.193:47465 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":78,"threads_started":1}
Aug 09 03:24:03 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:03 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:03.174110 18009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:03.168798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:55391)
0809 03:24:03.169006 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:03.169020 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:03.169116 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:03.169288 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:03.169289 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:03.169486 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:03.169536 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:03.169538 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:03.170385 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:03.170387 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:03.170929 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:03.170931 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:03.171358 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:03.171358 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:03.171419 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:03.171920 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:03.171926 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:03.174009 (+ 2083us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":103,"threads_started":1}
W20260809 03:24:03.174265 18008 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:03.168918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:55391 (local address 127.8.5.254:33325)
0809 03:24:03.169011 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:03.169013 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:03.169097 (+ 84us) server_negotiation.cc:407] Connection header received
0809 03:24:03.169189 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:03.169190 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:03.169204 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:03.169279 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:03.169619 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:03.170283 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:03.171059 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:03.171262 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:03.171357 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:03.174179 (+ 2822us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.194:55391: BlockingRecv error: recv got EOF from 127.8.5.194:55391 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 09 03:24:03 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:03 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:03.308267 18010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:03.303542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.195:58891)
0809 03:24:03.303748 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:03.303758 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:03.303819 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:03.303966 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:03.303967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:03.304173 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:03.304238 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:03.304240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:03.305063 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:03.305063 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:03.305585 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:03.305587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:03.305884 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:03.305884 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:03.305923 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:03.306381 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:03.306386 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:03.308210 (+ 1824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":117,"threads_started":1}
W20260809 03:24:03.308429 18008 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:03.303644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:58891 (local address 127.8.5.254:33325)
0809 03:24:03.303709 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:03.303710 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:03.303814 (+ 104us) server_negotiation.cc:407] Connection header received
0809 03:24:03.303877 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:03.303877 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:03.303891 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:03.303964 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:03.304359 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:03.304994 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:03.305652 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:03.305824 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:03.305873 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:03.308324 (+ 2451us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.195:58891: BlockingRecv error: recv got EOF from 127.8.5.195:58891 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 09 03:24:04 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:04 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:04.044008 18011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:04.039323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:48849)
0809 03:24:04.039465 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:04.039482 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:04.039529 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:04.039657 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:04.039657 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:04.039845 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:04.039897 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:04.039899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:04.040539 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:04.040540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:04.041070 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:04.041071 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:04.041450 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:04.041451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:04.041504 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:04.041975 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:04.041979 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:04.043948 (+ 1969us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":93,"threads_started":1}
W20260809 03:24:04.044122 18012 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:04.039399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:48849 (local address 127.8.5.254:33325)
0809 03:24:04.039527 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:04.039529 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:04.039545 (+ 16us) server_negotiation.cc:407] Connection header received
0809 03:24:04.039570 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:04.039570 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:04.039580 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:04.039644 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:04.039961 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:04.040461 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:04.041139 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:04.041346 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:04.041401 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:04.044042 (+ 2641us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.193:48849: BlockingRecv error: recv got EOF from 127.8.5.193:48849 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":80,"threads_started":1}
Aug 09 03:24:04 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:04 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:04.182184 18013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:04.174583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:53485)
0809 03:24:04.174772 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:04.174784 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:04.174848 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:04.175026 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:04.175026 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:04.175199 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:04.175266 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:04.175267 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:04.175914 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:04.175914 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:04.176445 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:04.176446 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:04.176791 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:04.176792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:04.176845 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:04.180306 (+ 3461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:04.180312 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:04.182124 (+ 1812us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":112,"threads_started":1}
W20260809 03:24:04.182315 18012 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:04.174672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:53485 (local address 127.8.5.254:33325)
0809 03:24:04.174750 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:04.174752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:04.174852 (+ 100us) server_negotiation.cc:407] Connection header received
0809 03:24:04.174909 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:04.174909 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:04.174920 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:04.174983 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:04.175331 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:04.175818 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:04.176517 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:04.176697 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:04.176748 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:04.182225 (+ 5477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.194:53485: BlockingRecv error: recv got EOF from 127.8.5.194:53485 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 09 03:24:04 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:04 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:04.313195 18014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:04.308737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.195:39695)
0809 03:24:04.308881 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:04.308891 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:04.308949 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:04.309094 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:04.309095 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:04.309260 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:04.309308 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:04.309310 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:04.309982 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:04.309983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:04.310491 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:04.310492 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:04.310817 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:04.310818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:04.310863 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:04.311372 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:04.311377 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:04.313135 (+ 1758us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":72,"threads_started":1}
W20260809 03:24:04.313359 18012 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:04.308826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:39695 (local address 127.8.5.254:33325)
0809 03:24:04.308892 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:04.308894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:04.308952 (+ 58us) server_negotiation.cc:407] Connection header received
0809 03:24:04.309009 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:04.309009 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:04.309022 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:04.309068 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:04.309370 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:04.309913 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:04.310557 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:04.310753 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:04.310806 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:04.313254 (+ 2448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.195:39695: BlockingRecv error: recv got EOF from 127.8.5.195:39695 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 09 03:24:05 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:05 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:05.051121 18015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:05.044573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:33829)
0809 03:24:05.044794 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:05.044805 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:05.044880 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:05.045071 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:05.045072 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:05.045320 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:05.045396 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:05.045398 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:05.046492 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:05.046492 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:05.047498 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:05.047501 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:05.048059 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:05.048061 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:05.048130 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:05.048774 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:05.048779 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:05.051035 (+ 2256us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":141,"threads_started":1}
W20260809 03:24:05.051529 18016 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:05.044632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:33829 (local address 127.8.5.254:33325)
0809 03:24:05.044795 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:05.044797 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:05.044871 (+ 74us) server_negotiation.cc:407] Connection header received
0809 03:24:05.044943 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:05.044944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:05.044960 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:05.045040 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:05.045506 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:05.046392 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:05.047594 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:05.047976 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:05.048056 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:05.051453 (+ 3397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.193:33829: BlockingRecv error: recv got EOF from 127.8.5.193:33829 (error 108)
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":79,"threads_started":1}
Aug 09 03:24:05 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:05 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:05.187471 18017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:05.182699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:44273)
0809 03:24:05.182861 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:05.182873 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:05.182938 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:05.183134 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:05.183135 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:05.183307 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:05.183375 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:05.183376 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:05.184029 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:05.184030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:05.184557 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:05.184558 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:05.184883 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:05.184884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:05.184925 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:05.185414 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:05.185419 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:05.187410 (+ 1991us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":101,"threads_started":1}
W20260809 03:24:05.187573 18016 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:05.182816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:44273 (local address 127.8.5.254:33325)
0809 03:24:05.182875 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:05.182877 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:05.182928 (+ 51us) server_negotiation.cc:407] Connection header received
0809 03:24:05.183050 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:05.183050 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:05.183060 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:05.183113 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:05.183443 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:05.183958 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:05.184627 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:05.184813 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:05.184882 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:05.187506 (+ 2624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.194:44273: BlockingRecv error: recv got EOF from 127.8.5.194:44273 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 09 03:24:05 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:05 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:05.318466 18018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:05.313679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.195:32791)
0809 03:24:05.313827 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:05.313853 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:05.313910 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:05.314058 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:05.314059 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:05.314224 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:05.314306 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:05.314308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:05.314981 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:05.314982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:05.315726 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:05.315730 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:05.316086 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:05.316088 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:05.316137 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:05.316607 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:05.316613 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:05.318405 (+ 1792us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":91,"threads_started":1}
W20260809 03:24:05.318562 18016 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:05.313791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:32791 (local address 127.8.5.254:33325)
0809 03:24:05.313853 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:05.313855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:05.313894 (+ 39us) server_negotiation.cc:407] Connection header received
0809 03:24:05.313966 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:05.313966 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:05.313978 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:05.314020 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:05.314372 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:05.314883 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:05.315803 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:05.315999 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:05.316053 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:05.318496 (+ 2443us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.195:32791: BlockingRecv error: recv got EOF from 127.8.5.195:32791 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 09 03:24:06 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:06 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:06.056488 18019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:06.051648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:60617)
0809 03:24:06.051824 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:06.051835 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:06.051888 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:06.052078 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:06.052079 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:06.052257 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:06.052310 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:06.052311 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:06.053025 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:06.053026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:06.053590 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:06.053593 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:06.053973 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:06.053974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:06.054038 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:06.054550 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:06.054555 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:06.056389 (+ 1834us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":116,"threads_started":1}
W20260809 03:24:06.056552 18020 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:06.051706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:60617 (local address 127.8.5.254:33325)
0809 03:24:06.051891 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:06.051893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:06.051905 (+ 12us) server_negotiation.cc:407] Connection header received
0809 03:24:06.051932 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:06.051933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:06.051943 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:06.052011 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:06.052375 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:06.052955 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:06.053679 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:06.053897 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:06.053973 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:06.056475 (+ 2502us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.193:60617: BlockingRecv error: recv got EOF from 127.8.5.193:60617 (error 108)
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":105,"threads_started":1}
Aug 09 03:24:06 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:06 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:06.192575 18021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:06.187972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:47793)
0809 03:24:06.188153 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:06.188164 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:06.188223 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:06.188346 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:06.188347 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:06.188516 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:06.188568 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:06.188569 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:06.189251 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:06.189251 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:06.189784 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:06.189785 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:06.190132 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:06.190133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:06.190174 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:06.190719 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:06.190724 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:06.192519 (+ 1795us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":121,"threads_started":1}
W20260809 03:24:06.192731 18020 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:06.188026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:47793 (local address 127.8.5.254:33325)
0809 03:24:06.188098 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:06.188100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:06.188226 (+ 126us) server_negotiation.cc:407] Connection header received
0809 03:24:06.188270 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:06.188270 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:06.188281 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:06.188330 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:06.188629 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:06.189142 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:06.189880 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:06.190073 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:06.190121 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:06.192641 (+ 2520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.194:47793: BlockingRecv error: recv got EOF from 127.8.5.194:47793 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 03:24:06 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:06 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:06.323872 18022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:06.319044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.195:46323)
0809 03:24:06.319219 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:06.319232 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:06.319326 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:06.319490 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:06.319491 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:06.319681 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:06.319730 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:06.319732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:06.320427 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:06.320428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:06.320968 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:06.320970 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:06.321336 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:06.321337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:06.321398 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:06.321936 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:06.321940 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:06.323809 (+ 1869us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":96,"threads_started":1}
W20260809 03:24:06.323983 18020 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:06.319133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:46323 (local address 127.8.5.254:33325)
0809 03:24:06.319205 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:06.319207 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:06.319304 (+ 97us) server_negotiation.cc:407] Connection header received
0809 03:24:06.319393 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:06.319395 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:06.319412 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:06.319483 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:06.319814 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:06.320317 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:06.321053 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:06.321251 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:06.321325 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:06.323906 (+ 2581us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.195:46323: BlockingRecv error: recv got EOF from 127.8.5.195:46323 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 09 03:24:07 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:07 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:07.061590 18023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:07.056963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:36167)
0809 03:24:07.057131 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:07.057146 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:07.057208 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:07.057377 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:07.057377 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:07.057542 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:07.057593 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:07.057595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:07.058218 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:07.058219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:07.058748 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:07.058750 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:07.059156 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:07.059157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:07.059202 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:07.059610 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:07.059614 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:07.061478 (+ 1864us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":85,"threads_started":1}
W20260809 03:24:07.061689 18024 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:07.057035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:36167 (local address 127.8.5.254:33325)
0809 03:24:07.057177 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:07.057179 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:07.057189 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:24:07.057285 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:07.057285 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:07.057296 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:07.057349 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:07.057656 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:07.058153 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:07.058828 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:07.059088 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:07.059144 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:07.061613 (+ 2469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.193:36167: BlockingRecv error: recv got EOF from 127.8.5.193:36167 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":73,"threads_started":1}
Aug 09 03:24:07 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:07 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:07.198426 18025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:07.193044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:55841)
0809 03:24:07.193229 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:07.193242 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:07.193350 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:07.193494 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:07.193495 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:07.193700 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:07.193751 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:07.193753 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:07.194519 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:07.194520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:07.195147 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:07.195149 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:07.195563 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:07.195564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:07.195638 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:07.196176 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:07.196190 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:07.198304 (+ 2114us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":88,"threads_started":1}
W20260809 03:24:07.198455 18024 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:07.193137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:55841 (local address 127.8.5.254:33325)
0809 03:24:07.193225 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:07.193228 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:07.193332 (+ 104us) server_negotiation.cc:407] Connection header received
0809 03:24:07.193416 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:07.193417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:07.193431 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:07.193491 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:07.193859 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:07.194416 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:07.195241 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:07.195467 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:07.195562 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:07.198381 (+ 2819us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.194:55841: BlockingRecv error: recv got EOF from 127.8.5.194:55841 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 09 03:24:07 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:07 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:07.328966 18026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:07.324395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.195:49415)
0809 03:24:07.324544 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:07.324556 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:07.324621 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:07.324756 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:07.324757 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:07.324944 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:07.324993 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:07.324996 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:07.325725 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:07.325725 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:07.326293 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:07.326295 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:07.326692 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:07.326693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:07.326755 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:07.327213 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:07.327217 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:07.328897 (+ 1680us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":101,"threads_started":1}
W20260809 03:24:07.329030 18024 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:07.324459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:49415 (local address 127.8.5.254:33325)
0809 03:24:07.324532 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:07.324534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:07.324620 (+ 86us) server_negotiation.cc:407] Connection header received
0809 03:24:07.324664 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:07.324665 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:07.324677 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:07.324730 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:07.325095 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:07.325631 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:07.326411 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:07.326595 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:07.326644 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:07.328983 (+ 2339us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.195:49415: BlockingRecv error: recv got EOF from 127.8.5.195:49415 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 03:24:08 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:08 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:08.067044 18028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:08.062157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:44173)
0809 03:24:08.062307 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:08.062322 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:08.062374 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:08.062500 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:08.062501 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:08.062658 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:08.062708 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:08.062709 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:08.063422 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:08.063423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:08.063971 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:08.063973 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:08.064312 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:08.064312 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:08.064356 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:08.064919 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:08.064924 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:08.066925 (+ 2001us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":81,"threads_started":1}
W20260809 03:24:08.067111 18029 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:08.062232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:44173 (local address 127.8.5.254:33325)
0809 03:24:08.062356 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:08.062359 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:08.062372 (+ 13us) server_negotiation.cc:407] Connection header received
0809 03:24:08.062428 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:08.062428 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:08.062438 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:08.062487 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:08.062796 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:08.063316 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:08.064050 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:08.064245 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:08.064295 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:08.067035 (+ 2740us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.193:44173: BlockingRecv error: recv got EOF from 127.8.5.193:44173 (error 108)
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":57,"threads_started":1}
Aug 09 03:24:08 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:08 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:08.203671 18030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:08.199050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:34761)
0809 03:24:08.199198 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:08.199209 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:08.199258 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:08.199389 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:08.199389 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:08.199565 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:08.199614 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:08.199616 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:08.200271 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:08.200272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:08.200846 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:08.200847 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:08.201167 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:08.201167 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:08.201209 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:08.201717 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:08.201723 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:08.203600 (+ 1877us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":84,"threads_started":1}
W20260809 03:24:08.203740 18029 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:08.199174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:34761 (local address 127.8.5.254:33325)
0809 03:24:08.199244 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:08.199245 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:08.199253 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:24:08.199316 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:08.199316 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:08.199327 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:08.199368 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:08.199680 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:08.200195 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:08.200920 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:08.201106 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:08.201154 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:08.203692 (+ 2538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.194:34761: BlockingRecv error: recv got EOF from 127.8.5.194:34761 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 09 03:24:08 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:08 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:08.334069 18031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:08.329410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.195:52797)
0809 03:24:08.329602 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:08.329614 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:08.329708 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:08.329886 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:08.329887 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:08.330067 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:08.330114 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:08.330116 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:08.330785 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:08.330786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:08.331345 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:08.331347 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:08.331710 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:08.331711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:08.331777 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:08.332202 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:08.332206 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:08.333963 (+ 1757us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":110,"threads_started":1}
W20260809 03:24:08.334159 18029 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:08.329499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:52797 (local address 127.8.5.254:33325)
0809 03:24:08.329583 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:08.329585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:08.329687 (+ 102us) server_negotiation.cc:407] Connection header received
0809 03:24:08.329775 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:08.329776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:08.329797 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:08.329862 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:08.330193 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:08.330693 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:08.331431 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:08.331622 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:08.331707 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:08.334072 (+ 2365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.195:52797: BlockingRecv error: recv got EOF from 127.8.5.195:52797 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 09 03:24:09 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:09 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:09.072018 18032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:09.067537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:57073)
0809 03:24:09.067684 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:09.067694 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:09.067777 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:09.067981 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:09.067982 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:09.068156 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:09.068208 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:09.068209 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:09.068855 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:09.068856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:09.069379 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:09.069380 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:09.069706 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:09.069707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:09.069749 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:09.070186 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:09.070191 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:09.071958 (+ 1767us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":86,"threads_started":1}
W20260809 03:24:09.072211 18033 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:09.067570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:57073 (local address 127.8.5.254:33325)
0809 03:24:09.067707 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:09.067709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:09.067757 (+ 48us) server_negotiation.cc:407] Connection header received
0809 03:24:09.067874 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:09.067874 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:09.067887 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:09.067962 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:09.068276 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:09.068773 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:09.069444 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:09.069627 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:09.069693 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:09.072112 (+ 2419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.193:57073: BlockingRecv error: recv got EOF from 127.8.5.193:57073 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":81,"threads_started":1}
Aug 09 03:24:09 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:09 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:09.215297 18034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:09.204207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:33049)
0809 03:24:09.204361 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:09.204372 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:09.204434 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:09.204567 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:09.204568 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:09.204735 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:09.204789 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:09.204790 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:09.205418 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:09.205419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:09.205930 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:09.205931 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:09.206276 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:09.206277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:09.206331 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:09.213195 (+ 6864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:09.213201 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:09.215226 (+ 2025us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":61,"threads_started":1}
W20260809 03:24:09.215437 18033 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:09.204289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:33049 (local address 127.8.5.254:33325)
0809 03:24:09.204389 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:09.204391 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:09.204419 (+ 28us) server_negotiation.cc:407] Connection header received
0809 03:24:09.204492 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:09.204493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:09.204505 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:09.204546 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:09.204856 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:09.205354 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:09.205998 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:09.206181 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:09.206233 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:09.215355 (+ 9122us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.194:33049: BlockingRecv error: recv got EOF from 127.8.5.194:33049 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 09 03:24:09 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:09 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.195@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:09.339547 18035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:09.334728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.195:55863)
0809 03:24:09.334939 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:09.334953 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:09.335048 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:09.335179 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:09.335179 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:09.335376 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:09.335424 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:09.335426 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:09.336110 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:09.336112 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:09.336815 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:09.336818 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:09.337216 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:09.337217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:09.337275 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:09.337705 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:09.337710 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:09.339449 (+ 1739us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":102,"threads_started":1}
W20260809 03:24:09.339601 18033 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:09.334856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:55863 (local address 127.8.5.254:33325)
0809 03:24:09.334944 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:09.334947 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:09.335044 (+ 97us) server_negotiation.cc:407] Connection header received
0809 03:24:09.335106 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:09.335107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:09.335123 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:09.335174 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:09.335507 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:09.336024 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:09.336890 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:09.337122 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:09.337215 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:09.339534 (+ 2319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.195:55863: BlockingRecv error: recv got EOF from 127.8.5.195:55863 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 09 03:24:10 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:10 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.193@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:10.077222 18036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:10.072565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.193:33743)
0809 03:24:10.072730 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:10.072744 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:10.072819 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:10.072982 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:10.072983 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:10.073150 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:10.073200 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:10.073202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.073866 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.073867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:10.074387 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:10.074389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.074711 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.074712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:10.074761 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:10.075300 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:10.075305 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:10.077162 (+ 1857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":74,"threads_started":1}
W20260809 03:24:10.077373 18037 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:10.072625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:33743 (local address 127.8.5.254:33325)
0809 03:24:10.072760 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:10.072762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:10.072800 (+ 38us) server_negotiation.cc:407] Connection header received
0809 03:24:10.072887 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:10.072888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:10.072898 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:10.072957 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:10.073274 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.073784 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.074460 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.074650 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.074699 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:10.077278 (+ 2579us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.193:33743: BlockingRecv error: recv got EOF from 127.8.5.193:33743 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":85,"threads_started":1}
Aug 09 03:24:10 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 03:24:10 dist-test-slave-2w3w krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.5.194@KRBTEST.COM for oryx/127.8.5.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 03:24:10.221187 18038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:10.215826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33325 (local address 127.8.5.194:58209)
0809 03:24:10.216042 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:10.216055 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:10.216157 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:10.216327 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:10.216327 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:10.216520 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:10.216568 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:10.216570 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.217271 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.217272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:10.217827 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:10.217829 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.218216 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.218217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:10.218282 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:10.218855 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:10.218861 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:10.221127 (+ 2266us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.5.254:33325: Server oryx/127.8.5.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":117,"threads_started":1}
W20260809 03:24:10.221295 18037 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:10.215926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:58209 (local address 127.8.5.254:33325)
0809 03:24:10.216030 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:10.216033 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:10.216137 (+ 104us) server_negotiation.cc:407] Connection header received
0809 03:24:10.216251 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:10.216252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:10.216264 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:10.216320 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:10.216653 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.217173 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.217916 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.218127 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.218216 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:10.221222 (+ 3006us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.5.194:58209: BlockingRecv error: recv got EOF from 127.8.5.194:58209 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 03:24:10.250867 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 17532
I20260809 03:24:10.259639 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 17697
I20260809 03:24:10.265729 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 17837
I20260809 03:24:10.271010 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 17454
2026-08-09T03:24:10Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17547 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T03:24:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:24:10Z Disabled control of system clock
I20260809 03:24:10.301657 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:37581
--webserver_interface=127.8.5.254
--webserver_port=0
--builtin_ntp_servers=127.8.5.212:45261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:37581
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 03:24:10.382710 18042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:24:10.382902 18042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:24:10.382922 18042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:24:10.384083 18042 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:24:10.384125 18042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:24:10.384138 18042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:24:10.384151 18042 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:24:10.384163 18042 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:24:10.385525 18042 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:45261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:37581
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:37581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:24:10.385728 18042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:24:10.385969 18042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:24:10.391333 18048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:10.391361 18050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:10.391362 18047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:24:10.391582 18042 server_base.cc:1034] running on GCE node
I20260809 03:24:10.391772 18042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:24:10.392045 18042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:24:10.393189 18042 hybrid_clock.cc:648] HybridClock initialized: now 1786245850393168 us; error 36 us; skew 500 ppm
I20260809 03:24:10.394516 18042 webserver.cc:460] Webserver started at http://127.8.5.254:45699/ using document root <none> and password file <none>
I20260809 03:24:10.394786 18042 fs_manager.cc:359] Metadata directory not provided
I20260809 03:24:10.394834 18042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:24:10.395035 18042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:24:10.396165 18042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "f717ac559d584d0a82e575f7c2fd44f1"
format_stamp: "Formatted at 2026-08-09 03:24:10 on dist-test-slave-2w3w"
server_key: "011ed35cf57e1a70277b800aebe3db84"
server_key_iv: "03c658fe434f00f82c67c9b6f9ccc612"
server_key_version: "encryptionkey@0"
I20260809 03:24:10.396526 18042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "f717ac559d584d0a82e575f7c2fd44f1"
format_stamp: "Formatted at 2026-08-09 03:24:10 on dist-test-slave-2w3w"
server_key: "011ed35cf57e1a70277b800aebe3db84"
server_key_iv: "03c658fe434f00f82c67c9b6f9ccc612"
server_key_version: "encryptionkey@0"
I20260809 03:24:10.397828 18042 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 03:24:10.398553 18057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:10.398741 18042 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:24:10.398844 18042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "f717ac559d584d0a82e575f7c2fd44f1"
format_stamp: "Formatted at 2026-08-09 03:24:10 on dist-test-slave-2w3w"
server_key: "011ed35cf57e1a70277b800aebe3db84"
server_key_iv: "03c658fe434f00f82c67c9b6f9ccc612"
server_key_version: "encryptionkey@0"
I20260809 03:24:10.398926 18042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:24:10.413908 18042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:24:10.414227 18042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:24:10.414388 18042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:24:10.418699 18042 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:37581
I20260809 03:24:10.418748 18116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:37581 every 8 connection(s)
I20260809 03:24:10.419158 18042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:24:10.419843 18117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:24:10.422325 18117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1: Bootstrap starting.
I20260809 03:24:10.422871 18117 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1: Neither blocks nor log segments found. Creating new log.
I20260809 03:24:10.423205 18117 log.cc:824] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1: Log is configured to *not* fsync() on all Append() calls
I20260809 03:24:10.423843 18117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1: No bootstrap required, opened a new log
I20260809 03:24:10.425374 18117 raft_consensus.cc:348] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f717ac559d584d0a82e575f7c2fd44f1" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 37581 } }
I20260809 03:24:10.425503 18117 raft_consensus.cc:374] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:24:10.425524 18117 raft_consensus.cc:729] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f717ac559d584d0a82e575f7c2fd44f1, State: Initialized, Role: FOLLOWER
I20260809 03:24:10.425653 18117 consensus_queue.cc:260] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f717ac559d584d0a82e575f7c2fd44f1" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 37581 } }
I20260809 03:24:10.425736 18117 raft_consensus.cc:388] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:24:10.425760 18117 raft_consensus.cc:482] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:24:10.425791 18117 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:24:10.426158 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 18042
I20260809 03:24:10.426260 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:24:10.426326 18117 raft_consensus.cc:504] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f717ac559d584d0a82e575f7c2fd44f1" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 37581 } }
I20260809 03:24:10.426453 18117 leader_election.cc:302] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f717ac559d584d0a82e575f7c2fd44f1; no voters:
I20260809 03:24:10.426501 8215 external_mini_cluster.cc:1428] Setting key 2b34f976df54305a0d51aa20c1c9f1ae
I20260809 03:24:10.426628 18117 leader_election.cc:288] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:24:10.426677 18120 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:24:10.426854 18120 raft_consensus.cc:686] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1 [term 1 LEADER]: Becoming Leader. State: Replica: f717ac559d584d0a82e575f7c2fd44f1, State: Running, Role: LEADER
I20260809 03:24:10.426885 18117 sys_catalog.cc:564] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:24:10.427042 18120 consensus_queue.cc:237] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f717ac559d584d0a82e575f7c2fd44f1" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 37581 } }
I20260809 03:24:10.427505 18122 sys_catalog.cc:455] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f717ac559d584d0a82e575f7c2fd44f1. Latest consensus state: current_term: 1 leader_uuid: "f717ac559d584d0a82e575f7c2fd44f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f717ac559d584d0a82e575f7c2fd44f1" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 37581 } } }
I20260809 03:24:10.427589 18122 sys_catalog.cc:458] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1 [sys.catalog]: This master's current role is: LEADER
I20260809 03:24:10.427644 18121 sys_catalog.cc:455] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f717ac559d584d0a82e575f7c2fd44f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f717ac559d584d0a82e575f7c2fd44f1" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 37581 } } }
I20260809 03:24:10.427731 18121 sys_catalog.cc:458] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1 [sys.catalog]: This master's current role is: LEADER
I20260809 03:24:10.427886 18128 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:24:10.428436 18128 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:24:10.430172 18128 catalog_manager.cc:1347] Generated new cluster ID: 2abe45bdf35749908ab61cae68b16d72
I20260809 03:24:10.430225 18128 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:24:10.433284 18124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:10.427174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57534 (local address 127.8.5.254:37581)
0809 03:24:10.427370 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:10.427380 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:10.427442 (+ 62us) server_negotiation.cc:407] Connection header received
0809 03:24:10.427992 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:10.428000 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:10.428073 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:10.428196 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:10.428595 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.429929 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.431068 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.431680 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.431793 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:10.432570 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:24:10.432574 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:24:10.432574 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:24:10.432780 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:24:10.432817 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:24:10.432830 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:24:10.432906 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:10.433007 (+ 101us) server_negotiation.cc:299] Negotiation successful
0809 03:24:10.433080 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":73,"threads_started":1}
I20260809 03:24:10.443430 18128 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:24:10.443945 18128 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:24:10.447394 18128 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f717ac559d584d0a82e575f7c2fd44f1: Generated new TSK 0
I20260809 03:24:10.447618 18128 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:24:10.452953 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:37581
--builtin_ntp_servers=127.8.5.212:45261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 03:24:10.538633 18141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:24:10.538858 18141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:24:10.538893 18141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:24:10.540060 18141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:24:10.540126 18141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:24:10.540170 18141 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:24:10.541509 18141 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:45261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:37581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:24:10.541772 18141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:24:10.542074 18141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:24:10.548009 18146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:10.548032 18147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:10.548081 18149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:24:10.548344 18141 server_base.cc:1034] running on GCE node
I20260809 03:24:10.548545 18141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:24:10.548811 18141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:24:10.549984 18141 hybrid_clock.cc:648] HybridClock initialized: now 1786245850549974 us; error 27 us; skew 500 ppm
I20260809 03:24:10.551297 18141 webserver.cc:460] Webserver started at http://127.8.5.193:41307/ using document root <none> and password file <none>
I20260809 03:24:10.551560 18141 fs_manager.cc:359] Metadata directory not provided
I20260809 03:24:10.551604 18141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:24:10.551733 18141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:24:10.552768 18141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "e6f46c1bedc04cac94848b1af31d64da"
format_stamp: "Formatted at 2026-08-09 03:24:10 on dist-test-slave-2w3w"
server_key: "e2bc47e3da3c8450e4edec7f0543cbf0"
server_key_iv: "fd860ff0c2796bac6f62de857843e805"
server_key_version: "encryptionkey@0"
I20260809 03:24:10.553153 18141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "e6f46c1bedc04cac94848b1af31d64da"
format_stamp: "Formatted at 2026-08-09 03:24:10 on dist-test-slave-2w3w"
server_key: "e2bc47e3da3c8450e4edec7f0543cbf0"
server_key_iv: "fd860ff0c2796bac6f62de857843e805"
server_key_version: "encryptionkey@0"
I20260809 03:24:10.554482 18141 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:24:10.555335 18156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:10.555600 18141 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:24:10.555709 18141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "e6f46c1bedc04cac94848b1af31d64da"
format_stamp: "Formatted at 2026-08-09 03:24:10 on dist-test-slave-2w3w"
server_key: "e2bc47e3da3c8450e4edec7f0543cbf0"
server_key_iv: "fd860ff0c2796bac6f62de857843e805"
server_key_version: "encryptionkey@0"
I20260809 03:24:10.555804 18141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:24:10.577936 18141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:24:10.578255 18141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:24:10.578416 18141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:24:10.578645 18141 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:24:10.579090 18141 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:24:10.579145 18141 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:10.579180 18141 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:24:10.579206 18141 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:10.584996 18141 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:46789
I20260809 03:24:10.585089 18275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:46789 every 8 connection(s)
I20260809 03:24:10.585419 18141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:24:10.589140 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 18141
I20260809 03:24:10.589236 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:24:10.589442 8215 external_mini_cluster.cc:1428] Setting key c8966dc9f016ae7acec7c6552f69e1da
I20260809 03:24:10.590698 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:37581
--builtin_ntp_servers=127.8.5.212:45261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 03:24:10.591324 18124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:10.586265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:55263 (local address 127.8.5.254:37581)
0809 03:24:10.586327 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:10.586330 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:10.586598 (+ 268us) server_negotiation.cc:407] Connection header received
0809 03:24:10.587177 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:10.587178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:10.587196 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:10.587278 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:10.587949 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.588473 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.589512 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.589808 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.589875 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:10.590944 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:24:10.590945 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:24:10.590945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:24:10.590951 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:24:10.590966 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:24:10.590998 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:24:10.591035 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:10.591157 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 03:24:10.591196 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 03:24:10.591420 18278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:10.586222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:37581 (local address 127.8.5.193:55263)
0809 03:24:10.586438 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:10.586480 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:10.587063 (+ 583us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:10.587357 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:10.587361 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:10.587369 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:10.587872 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:10.587876 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.588557 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.588558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:10.589418 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:10.589422 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.589911 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.589912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:10.590075 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:10.590751 (+ 676us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:24:10.590752 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:10.590780 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:24:10.590826 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:24:10.591071 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:24:10.591076 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:24:10.591078 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:24:10.591129 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 03:24:10.591216 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":120,"threads_started":1}
I20260809 03:24:10.592844 18276 heartbeater.cc:347] Connected to a master server at 127.8.5.254:37581
I20260809 03:24:10.592931 18276 heartbeater.cc:464] Registering TS with master...
I20260809 03:24:10.593139 18276 heartbeater.cc:511] Master 127.8.5.254:37581 requested a full tablet report, sending...
I20260809 03:24:10.593739 18076 ts_manager.cc:194] Registered new tserver with Master: e6f46c1bedc04cac94848b1af31d64da (127.8.5.193:46789)
I20260809 03:24:10.594393 18076 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.5.193:55263
W20260809 03:24:10.672552 18279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:24:10.672735 18279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:24:10.672756 18279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:24:10.673908 18279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:24:10.673949 18279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:24:10.673972 18279 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:24:10.675341 18279 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:45261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:37581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18279
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:24:10.675572 18279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:24:10.675869 18279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:24:10.680833 18286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:10.680842 18288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:10.680914 18285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:24:10.681314 18279 server_base.cc:1034] running on GCE node
I20260809 03:24:10.681571 18279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:24:10.681834 18279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:24:10.683027 18279 hybrid_clock.cc:648] HybridClock initialized: now 1786245850683005 us; error 36 us; skew 500 ppm
I20260809 03:24:10.684258 18279 webserver.cc:460] Webserver started at http://127.8.5.194:39801/ using document root <none> and password file <none>
I20260809 03:24:10.684531 18279 fs_manager.cc:359] Metadata directory not provided
I20260809 03:24:10.684585 18279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:24:10.684756 18279 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:24:10.685827 18279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "54f125a3e3d049f4ad2adc3ea151433b"
format_stamp: "Formatted at 2026-08-09 03:24:10 on dist-test-slave-2w3w"
server_key: "f2c836e95039b51de40736b97bc2bc45"
server_key_iv: "6189b5bb3ca256232c76cdce5342612f"
server_key_version: "encryptionkey@0"
I20260809 03:24:10.686197 18279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "54f125a3e3d049f4ad2adc3ea151433b"
format_stamp: "Formatted at 2026-08-09 03:24:10 on dist-test-slave-2w3w"
server_key: "f2c836e95039b51de40736b97bc2bc45"
server_key_iv: "6189b5bb3ca256232c76cdce5342612f"
server_key_version: "encryptionkey@0"
I20260809 03:24:10.687595 18279 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:24:10.688301 18294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:10.688482 18279 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:24:10.688583 18279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "54f125a3e3d049f4ad2adc3ea151433b"
format_stamp: "Formatted at 2026-08-09 03:24:10 on dist-test-slave-2w3w"
server_key: "f2c836e95039b51de40736b97bc2bc45"
server_key_iv: "6189b5bb3ca256232c76cdce5342612f"
server_key_version: "encryptionkey@0"
I20260809 03:24:10.688660 18279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:24:10.706933 18279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:24:10.707257 18279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:24:10.707417 18279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:24:10.707657 18279 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:24:10.707988 18279 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:24:10.708042 18279 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:10.708076 18279 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:24:10.708104 18279 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:10.713840 18279 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:46309
I20260809 03:24:10.713888 18417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:46309 every 8 connection(s)
I20260809 03:24:10.714196 18279 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:24:10.716609 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 18279
I20260809 03:24:10.716697 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:24:10.716886 8215 external_mini_cluster.cc:1428] Setting key d8e21cc37a139f37ce2d1c9351e8966f
I20260809 03:24:10.717907 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:37581
--builtin_ntp_servers=127.8.5.212:45261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 03:24:10.720062 18124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:10.714907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:52501 (local address 127.8.5.254:37581)
0809 03:24:10.714971 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:10.714973 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:10.715216 (+ 243us) server_negotiation.cc:407] Connection header received
0809 03:24:10.715686 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:10.715687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:10.715696 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:10.715759 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:10.716451 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.717198 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.718466 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.718775 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.718849 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:10.719801 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:24:10.719803 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:24:10.719803 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:24:10.719807 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:24:10.719820 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:24:10.719824 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:24:10.719870 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:10.719977 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 03:24:10.720002 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 03:24:10.720361 18420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:10.714871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:37581 (local address 127.8.5.194:52501)
0809 03:24:10.715083 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:10.715123 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:10.715604 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:10.715832 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:10.715836 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:10.715857 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:10.716346 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:10.716370 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.717316 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.717317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:10.718381 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:10.718384 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.718865 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.718866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:10.719020 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:10.719626 (+ 606us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:24:10.719627 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:10.719668 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:24:10.719702 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:24:10.719890 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:24:10.719896 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:24:10.719899 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:24:10.719973 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 03:24:10.720090 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":121,"threads_started":1}
I20260809 03:24:10.720976 18418 heartbeater.cc:347] Connected to a master server at 127.8.5.254:37581
I20260809 03:24:10.721061 18418 heartbeater.cc:464] Registering TS with master...
I20260809 03:24:10.721261 18418 heartbeater.cc:511] Master 127.8.5.254:37581 requested a full tablet report, sending...
I20260809 03:24:10.721685 18076 ts_manager.cc:194] Registered new tserver with Master: 54f125a3e3d049f4ad2adc3ea151433b (127.8.5.194:46309)
I20260809 03:24:10.722059 18076 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.5.194:52501
W20260809 03:24:10.799767 18421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:24:10.800004 18421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:24:10.800037 18421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:24:10.801215 18421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:24:10.801282 18421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:24:10.801323 18421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:24:10.802788 18421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:45261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:37581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:24:10.803071 18421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:24:10.803330 18421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:24:10.808259 18427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:10.808257 18429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:10.808296 18426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:24:10.808583 18421 server_base.cc:1034] running on GCE node
I20260809 03:24:10.808789 18421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:24:10.809042 18421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:24:10.810216 18421 hybrid_clock.cc:648] HybridClock initialized: now 1786245850810201 us; error 26 us; skew 500 ppm
I20260809 03:24:10.811446 18421 webserver.cc:460] Webserver started at http://127.8.5.195:34893/ using document root <none> and password file <none>
I20260809 03:24:10.811681 18421 fs_manager.cc:359] Metadata directory not provided
I20260809 03:24:10.811749 18421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:24:10.811910 18421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:24:10.813035 18421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "b9b2ea2f278147b6aa3e9be9bd4f5210"
format_stamp: "Formatted at 2026-08-09 03:24:10 on dist-test-slave-2w3w"
server_key: "57f292b56f9da63c81814ff640f17cfd"
server_key_iv: "d926680f63947df0a08ec11c71f88d4a"
server_key_version: "encryptionkey@0"
I20260809 03:24:10.813522 18421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "b9b2ea2f278147b6aa3e9be9bd4f5210"
format_stamp: "Formatted at 2026-08-09 03:24:10 on dist-test-slave-2w3w"
server_key: "57f292b56f9da63c81814ff640f17cfd"
server_key_iv: "d926680f63947df0a08ec11c71f88d4a"
server_key_version: "encryptionkey@0"
I20260809 03:24:10.814918 18421 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 03:24:10.815683 18436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:10.815847 18421 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:24:10.815943 18421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "b9b2ea2f278147b6aa3e9be9bd4f5210"
format_stamp: "Formatted at 2026-08-09 03:24:10 on dist-test-slave-2w3w"
server_key: "57f292b56f9da63c81814ff640f17cfd"
server_key_iv: "d926680f63947df0a08ec11c71f88d4a"
server_key_version: "encryptionkey@0"
I20260809 03:24:10.816030 18421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:24:10.838209 18421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:24:10.838562 18421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:24:10.838726 18421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:24:10.839042 18421 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:24:10.839385 18421 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:24:10.839440 18421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:10.839475 18421 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:24:10.839502 18421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:10.845230 18421 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:42837
I20260809 03:24:10.845309 18557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:42837 every 8 connection(s)
I20260809 03:24:10.845638 18421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:24:10.851063 18124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:10.846390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:32855 (local address 127.8.5.254:37581)
0809 03:24:10.846463 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:10.846465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:10.846697 (+ 232us) server_negotiation.cc:407] Connection header received
0809 03:24:10.847394 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:10.847395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:10.847408 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:10.847463 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:10.848128 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.848655 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.849649 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.849872 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.849952 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:10.850706 (+ 754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:24:10.850707 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:24:10.850707 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:24:10.850713 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:24:10.850729 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:24:10.850733 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:24:10.850799 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:10.850932 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 03:24:10.850981 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 03:24:10.851284 18560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:10.846364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:37581 (local address 127.8.5.195:32855)
0809 03:24:10.846579 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:10.846611 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:10.847255 (+ 644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:10.847535 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:10.847543 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:10.847551 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:10.848029 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:10.848033 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.848766 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.848767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:10.849555 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:10.849557 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:10.849959 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:10.849960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:10.850089 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:10.850570 (+ 481us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:24:10.850570 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:10.850597 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:24:10.850618 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:24:10.850840 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:24:10.850845 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:24:10.850847 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:24:10.850932 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 03:24:10.851053 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":94,"threads_started":1}
I20260809 03:24:10.851766 18558 heartbeater.cc:347] Connected to a master server at 127.8.5.254:37581
I20260809 03:24:10.851861 18558 heartbeater.cc:464] Registering TS with master...
I20260809 03:24:10.852034 18558 heartbeater.cc:511] Master 127.8.5.254:37581 requested a full tablet report, sending...
I20260809 03:24:10.852571 18076 ts_manager.cc:194] Registered new tserver with Master: b9b2ea2f278147b6aa3e9be9bd4f5210 (127.8.5.195:42837)
I20260809 03:24:10.852998 18076 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.5.195:32855
I20260809 03:24:10.854038 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 18421
I20260809 03:24:10.854112 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:24:10.854295 8215 external_mini_cluster.cc:1428] Setting key 7dd8b89f45b78c16abab65dc6adb56d7
I20260809 03:24:10.855297 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 03:24:10.857072 18124 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:10.856636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57550 (local address 127.8.5.254:37581)
0809 03:24:10.856702 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:10.856704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:10.856785 (+ 81us) server_negotiation.cc:407] Connection header received
0809 03:24:10.856823 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:10.856824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:10.856834 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:10.856885 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:10.857017 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57550: BlockingRecv error: recv got EOF from 127.0.0.1:57550 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 03:24:10.857122 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 18141
I20260809 03:24:10.867079 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 18279
I20260809 03:24:10.873008 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 18421
I20260809 03:24:10.878198 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 18042
2026-08-09T03:24:10Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (605 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T03:24:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:24:10Z Disabled control of system clock
I20260809 03:24:10.906212 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:32943
--webserver_interface=127.8.5.254
--webserver_port=0
--builtin_ntp_servers=127.8.5.212:43593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:32943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 03:24:10.986766 18570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:24:10.986989 18570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:24:10.987010 18570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:24:10.988095 18570 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:24:10.988130 18570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:24:10.988142 18570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:24:10.988154 18570 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:24:10.988166 18570 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:24:10.989444 18570 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:43593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:32943
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:32943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18570
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:24:10.989627 18570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:24:10.989869 18570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:24:10.994665 18575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:10.994786 18576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:10.994659 18578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:24:10.994952 18570 server_base.cc:1034] running on GCE node
I20260809 03:24:10.995194 18570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:24:10.995438 18570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:24:10.996609 18570 hybrid_clock.cc:648] HybridClock initialized: now 1786245850996597 us; error 28 us; skew 500 ppm
I20260809 03:24:10.997953 18570 webserver.cc:460] Webserver started at http://127.8.5.254:42943/ using document root <none> and password file <none>
I20260809 03:24:10.998208 18570 fs_manager.cc:359] Metadata directory not provided
I20260809 03:24:10.998256 18570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:24:10.998432 18570 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:24:10.999538 18570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "36d2e1a2557b4031a03f6d70f5c33784"
format_stamp: "Formatted at 2026-08-09 03:24:10 on dist-test-slave-2w3w"
server_key: "2cbcfbb512621edc7d3a79f9812017a9"
server_key_iv: "ebb3e9dc4852962e0264d4bbaac044c8"
server_key_version: "encryptionkey@0"
I20260809 03:24:10.999907 18570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "36d2e1a2557b4031a03f6d70f5c33784"
format_stamp: "Formatted at 2026-08-09 03:24:10 on dist-test-slave-2w3w"
server_key: "2cbcfbb512621edc7d3a79f9812017a9"
server_key_iv: "ebb3e9dc4852962e0264d4bbaac044c8"
server_key_version: "encryptionkey@0"
I20260809 03:24:11.001330 18570 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:24:11.002096 18584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:11.002285 18570 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:24:11.002372 18570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "36d2e1a2557b4031a03f6d70f5c33784"
format_stamp: "Formatted at 2026-08-09 03:24:10 on dist-test-slave-2w3w"
server_key: "2cbcfbb512621edc7d3a79f9812017a9"
server_key_iv: "ebb3e9dc4852962e0264d4bbaac044c8"
server_key_version: "encryptionkey@0"
I20260809 03:24:11.002425 18570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:24:11.005642 18570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:24:11.005861 18570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:24:11.005956 18570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:24:11.009690 18570 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:32943
I20260809 03:24:11.009734 18637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:32943 every 8 connection(s)
I20260809 03:24:11.010037 18570 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:24:11.010416 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 18570
I20260809 03:24:11.010507 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:24:11.010703 8215 external_mini_cluster.cc:1428] Setting key 0696d19f384834f6571053d3ab0a3d83
I20260809 03:24:11.010787 18638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:24:11.013727 18641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:11.011491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58452 (local address 127.8.5.254:32943)
0809 03:24:11.011692 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:11.011700 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:11.011730 (+ 30us) server_negotiation.cc:407] Connection header received
0809 03:24:11.012440 (+ 710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:11.012449 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:11.012504 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:11.012652 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:11.013296 (+ 644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:24:11.013299 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:24:11.013300 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:24:11.013304 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:24:11.013359 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:24:11.013373 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:24:11.013451 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:11.013496 (+ 45us) server_negotiation.cc:299] Negotiation successful
0809 03:24:11.013549 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":71,"threads_started":1}
I20260809 03:24:11.014322 18638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784: Bootstrap starting.
I20260809 03:24:11.014952 18638 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784: Neither blocks nor log segments found. Creating new log.
I20260809 03:24:11.015259 18638 log.cc:824] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784: Log is configured to *not* fsync() on all Append() calls
I20260809 03:24:11.015889 18638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784: No bootstrap required, opened a new log
I20260809 03:24:11.017256 18638 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36d2e1a2557b4031a03f6d70f5c33784" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 32943 } }
I20260809 03:24:11.017385 18638 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:24:11.017408 18638 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36d2e1a2557b4031a03f6d70f5c33784, State: Initialized, Role: FOLLOWER
I20260809 03:24:11.017488 18638 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36d2e1a2557b4031a03f6d70f5c33784" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 32943 } }
I20260809 03:24:11.017544 18638 raft_consensus.cc:388] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:24:11.017565 18638 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:24:11.017591 18638 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:24:11.018266 18638 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36d2e1a2557b4031a03f6d70f5c33784" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 32943 } }
I20260809 03:24:11.018355 18638 leader_election.cc:302] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36d2e1a2557b4031a03f6d70f5c33784; no voters:
I20260809 03:24:11.018483 18638 leader_election.cc:288] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:24:11.018740 18638 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:24:11.018743 18643 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:24:11.018896 18643 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784 [term 1 LEADER]: Becoming Leader. State: Replica: 36d2e1a2557b4031a03f6d70f5c33784, State: Running, Role: LEADER
I20260809 03:24:11.019006 18643 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36d2e1a2557b4031a03f6d70f5c33784" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 32943 } }
I20260809 03:24:11.019368 18644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36d2e1a2557b4031a03f6d70f5c33784" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36d2e1a2557b4031a03f6d70f5c33784" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 32943 } } }
I20260809 03:24:11.019466 18644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784 [sys.catalog]: This master's current role is: LEADER
I20260809 03:24:11.019637 18644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36d2e1a2557b4031a03f6d70f5c33784. Latest consensus state: current_term: 1 leader_uuid: "36d2e1a2557b4031a03f6d70f5c33784" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36d2e1a2557b4031a03f6d70f5c33784" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 32943 } } }
I20260809 03:24:11.019706 18644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784 [sys.catalog]: This master's current role is: LEADER
I20260809 03:24:11.019690 18653 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:24:11.020627 18653 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:24:11.022089 18653 catalog_manager.cc:1347] Generated new cluster ID: 3fed8d335eb64cb2bc36b3a9ec36d929
I20260809 03:24:11.022146 18653 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:24:11.053416 18653 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:24:11.053717 18653 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:24:11.062245 18653 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36d2e1a2557b4031a03f6d70f5c33784: Generated new TSK 0
I20260809 03:24:11.062451 18653 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:24:11.067893 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:32943
--builtin_ntp_servers=127.8.5.212:43593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 03:24:11.149652 18663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:24:11.149858 18663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:24:11.149880 18663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:24:11.151079 18663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:24:11.151117 18663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:24:11.151144 18663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:24:11.152444 18663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:43593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:32943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:24:11.152696 18663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:24:11.153003 18663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:24:11.157999 18671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:24:11.158077 18663 server_base.cc:1034] running on GCE node
W20260809 03:24:11.158027 18669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:11.157958 18668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:24:11.158373 18663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:24:11.158583 18663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:24:11.159749 18663 hybrid_clock.cc:648] HybridClock initialized: now 1786245851159738 us; error 28 us; skew 500 ppm
I20260809 03:24:11.160921 18663 webserver.cc:460] Webserver started at http://127.8.5.193:44967/ using document root <none> and password file <none>
I20260809 03:24:11.161168 18663 fs_manager.cc:359] Metadata directory not provided
I20260809 03:24:11.161237 18663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:24:11.161401 18663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:24:11.162446 18663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "e79c5a3e203c42938822355d22fb17f4"
format_stamp: "Formatted at 2026-08-09 03:24:11 on dist-test-slave-2w3w"
server_key: "3fb387d56fd47a1c4c638bf9da273568"
server_key_iv: "b222322b1de77dc0277969e053a6aaca"
server_key_version: "encryptionkey@0"
I20260809 03:24:11.162810 18663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "e79c5a3e203c42938822355d22fb17f4"
format_stamp: "Formatted at 2026-08-09 03:24:11 on dist-test-slave-2w3w"
server_key: "3fb387d56fd47a1c4c638bf9da273568"
server_key_iv: "b222322b1de77dc0277969e053a6aaca"
server_key_version: "encryptionkey@0"
I20260809 03:24:11.164098 18663 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:24:11.164804 18678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:11.164988 18663 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:24:11.165084 18663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "e79c5a3e203c42938822355d22fb17f4"
format_stamp: "Formatted at 2026-08-09 03:24:11 on dist-test-slave-2w3w"
server_key: "3fb387d56fd47a1c4c638bf9da273568"
server_key_iv: "b222322b1de77dc0277969e053a6aaca"
server_key_version: "encryptionkey@0"
I20260809 03:24:11.165165 18663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:24:11.168496 18663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:24:11.168751 18663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:24:11.168897 18663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:24:11.169107 18663 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:24:11.169416 18663 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:24:11.169472 18663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:11.169512 18663 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:24:11.169540 18663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:11.175356 18663 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:41243
I20260809 03:24:11.175448 18797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:41243 every 8 connection(s)
I20260809 03:24:11.175748 18663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:24:11.178541 18641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:11.176495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:54313 (local address 127.8.5.254:32943)
0809 03:24:11.176544 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:11.176545 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:11.176743 (+ 198us) server_negotiation.cc:407] Connection header received
0809 03:24:11.177195 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:11.177196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:11.177202 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:11.177254 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:11.178363 (+ 1109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:24:11.178364 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:24:11.178365 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:24:11.178369 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:24:11.178383 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:24:11.178387 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:24:11.178433 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:11.178479 (+ 46us) server_negotiation.cc:299] Negotiation successful
0809 03:24:11.178490 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 03:24:11.178725 18801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:11.176466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:32943 (local address 127.8.5.193:54313)
0809 03:24:11.176645 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:11.176676 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:11.177109 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:11.177307 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:11.177310 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:11.177318 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:11.178215 (+ 897us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:24:11.178216 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:11.178244 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:24:11.178273 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:24:11.178431 (+ 158us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:24:11.178433 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:24:11.178435 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:24:11.178486 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 03:24:11.178533 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260809 03:24:11.179306 18798 heartbeater.cc:347] Connected to a master server at 127.8.5.254:32943
I20260809 03:24:11.179383 18798 heartbeater.cc:464] Registering TS with master...
I20260809 03:24:11.179488 18798 heartbeater.cc:511] Master 127.8.5.254:32943 requested a full tablet report, sending...
I20260809 03:24:11.179955 18602 ts_manager.cc:194] Registered new tserver with Master: e79c5a3e203c42938822355d22fb17f4 (127.8.5.193:41243)
I20260809 03:24:11.183446 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 18663
I20260809 03:24:11.183550 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:24:11.183743 8215 external_mini_cluster.cc:1428] Setting key 1599adff45fe50366649a1d3f00d1f42
I20260809 03:24:11.184700 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:32943
--builtin_ntp_servers=127.8.5.212:43593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 03:24:11.266360 18802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:24:11.266549 18802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:24:11.266570 18802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:24:11.267863 18802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:24:11.267902 18802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:24:11.267946 18802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:24:11.269397 18802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:43593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:32943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:24:11.269631 18802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:24:11.269917 18802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:24:11.274745 18807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:11.274794 18810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:11.274802 18808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:24:11.274988 18802 server_base.cc:1034] running on GCE node
I20260809 03:24:11.275259 18802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:24:11.275499 18802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:24:11.276664 18802 hybrid_clock.cc:648] HybridClock initialized: now 1786245851276645 us; error 40 us; skew 500 ppm
I20260809 03:24:11.277788 18802 webserver.cc:460] Webserver started at http://127.8.5.194:36115/ using document root <none> and password file <none>
I20260809 03:24:11.278024 18802 fs_manager.cc:359] Metadata directory not provided
I20260809 03:24:11.278086 18802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:24:11.278216 18802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:24:11.279383 18802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "948d1a9f082c45c6a0a912fcb556efe5"
format_stamp: "Formatted at 2026-08-09 03:24:11 on dist-test-slave-2w3w"
server_key: "0a23c71a4f674ee8b1e60498b8f00844"
server_key_iv: "f895f12dcfb23824825faed84e771498"
server_key_version: "encryptionkey@0"
I20260809 03:24:11.279736 18802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "948d1a9f082c45c6a0a912fcb556efe5"
format_stamp: "Formatted at 2026-08-09 03:24:11 on dist-test-slave-2w3w"
server_key: "0a23c71a4f674ee8b1e60498b8f00844"
server_key_iv: "f895f12dcfb23824825faed84e771498"
server_key_version: "encryptionkey@0"
I20260809 03:24:11.281006 18802 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:24:11.281711 18816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:11.281905 18802 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:24:11.281993 18802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "948d1a9f082c45c6a0a912fcb556efe5"
format_stamp: "Formatted at 2026-08-09 03:24:11 on dist-test-slave-2w3w"
server_key: "0a23c71a4f674ee8b1e60498b8f00844"
server_key_iv: "f895f12dcfb23824825faed84e771498"
server_key_version: "encryptionkey@0"
I20260809 03:24:11.282060 18802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:24:11.285348 18802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:24:11.285612 18802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:24:11.285742 18802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:24:11.285961 18802 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:24:11.286257 18802 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:24:11.286288 18802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:11.286309 18802 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:24:11.286360 18802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:11.292193 18802 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:42457
I20260809 03:24:11.292241 18937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:42457 every 8 connection(s)
I20260809 03:24:11.292531 18802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:24:11.295233 18641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:11.293203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:32943 (local address 127.8.5.254:32943)
0809 03:24:11.293279 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:11.293281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:11.293457 (+ 176us) server_negotiation.cc:407] Connection header received
0809 03:24:11.293876 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:11.293877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:11.293881 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:11.293935 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:11.295017 (+ 1082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:24:11.295019 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:24:11.295019 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:24:11.295024 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:24:11.295040 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:24:11.295051 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:24:11.295098 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:11.295166 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 03:24:11.295179 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 03:24:11.295393 18940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:11.293144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:32943 (local address 127.8.5.194:32943)
0809 03:24:11.293340 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:11.293372 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:11.293785 (+ 413us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:11.293981 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:11.293984 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:11.293991 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:11.294844 (+ 853us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:24:11.294845 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:11.294870 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:24:11.294896 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:24:11.295100 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:24:11.295103 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:24:11.295105 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:24:11.295161 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 03:24:11.295205 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":94,"threads_started":1}
I20260809 03:24:11.295876 18938 heartbeater.cc:347] Connected to a master server at 127.8.5.254:32943
I20260809 03:24:11.295984 18938 heartbeater.cc:464] Registering TS with master...
I20260809 03:24:11.296128 18938 heartbeater.cc:511] Master 127.8.5.254:32943 requested a full tablet report, sending...
I20260809 03:24:11.296502 18602 ts_manager.cc:194] Registered new tserver with Master: 948d1a9f082c45c6a0a912fcb556efe5 (127.8.5.194:42457)
I20260809 03:24:11.299825 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 18802
I20260809 03:24:11.299940 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:24:11.300118 8215 external_mini_cluster.cc:1428] Setting key 2009ed30654d64c29bcc2eb292da226e
I20260809 03:24:11.301026 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:32943
--builtin_ntp_servers=127.8.5.212:43593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 03:24:11.382273 18942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:24:11.382463 18942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:24:11.382484 18942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:24:11.383677 18942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:24:11.383719 18942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:24:11.383744 18942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:24:11.385244 18942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:43593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:32943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18942
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:24:11.385491 18942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:24:11.385854 18942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:24:11.390810 18947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:11.390864 18948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:24:11.390923 18942 server_base.cc:1034] running on GCE node
W20260809 03:24:11.390870 18950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:24:11.391278 18942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:24:11.391520 18942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:24:11.392688 18942 hybrid_clock.cc:648] HybridClock initialized: now 1786245851392676 us; error 28 us; skew 500 ppm
I20260809 03:24:11.393841 18942 webserver.cc:460] Webserver started at http://127.8.5.195:35251/ using document root <none> and password file <none>
I20260809 03:24:11.394094 18942 fs_manager.cc:359] Metadata directory not provided
I20260809 03:24:11.394163 18942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:24:11.394320 18942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:24:11.395429 18942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "80749d0e4bdf42d5a9dbb80ac27ec24a"
format_stamp: "Formatted at 2026-08-09 03:24:11 on dist-test-slave-2w3w"
server_key: "dde18ca833ab3965267a29b86ad0a068"
server_key_iv: "c13ddcb4fe37f10d51bc589c79c4b490"
server_key_version: "encryptionkey@0"
I20260809 03:24:11.395782 18942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "80749d0e4bdf42d5a9dbb80ac27ec24a"
format_stamp: "Formatted at 2026-08-09 03:24:11 on dist-test-slave-2w3w"
server_key: "dde18ca833ab3965267a29b86ad0a068"
server_key_iv: "c13ddcb4fe37f10d51bc589c79c4b490"
server_key_version: "encryptionkey@0"
I20260809 03:24:11.397065 18942 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:24:11.397809 18956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:11.398006 18942 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:24:11.398111 18942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "80749d0e4bdf42d5a9dbb80ac27ec24a"
format_stamp: "Formatted at 2026-08-09 03:24:11 on dist-test-slave-2w3w"
server_key: "dde18ca833ab3965267a29b86ad0a068"
server_key_iv: "c13ddcb4fe37f10d51bc589c79c4b490"
server_key_version: "encryptionkey@0"
I20260809 03:24:11.398193 18942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:24:11.401435 18942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:24:11.401684 18942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:24:11.401831 18942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:24:11.402050 18942 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:24:11.402338 18942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:24:11.402391 18942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:11.402429 18942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:24:11.402457 18942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:11.408538 18942 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:41359
I20260809 03:24:11.408573 19081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:41359 every 8 connection(s)
I20260809 03:24:11.408890 18942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:24:11.411821 18641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:11.409557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:43087 (local address 127.8.5.254:32943)
0809 03:24:11.409601 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:11.409603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:11.409811 (+ 208us) server_negotiation.cc:407] Connection header received
0809 03:24:11.410312 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:11.410313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:11.410319 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:11.410376 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:11.411552 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:24:11.411554 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:24:11.411554 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:24:11.411559 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:24:11.411575 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:24:11.411579 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:24:11.411632 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:11.411728 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 03:24:11.411744 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 03:24:11.412005 19085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:11.409540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:32943 (local address 127.8.5.195:43087)
0809 03:24:11.409695 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:11.409725 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:11.410200 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:11.410449 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:11.410453 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:11.410463 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:11.411406 (+ 943us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:24:11.411406 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:11.411433 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:24:11.411460 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:24:11.411629 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:24:11.411634 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:24:11.411637 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:24:11.411737 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 03:24:11.411794 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":66,"threads_started":1}
I20260809 03:24:11.412426 19082 heartbeater.cc:347] Connected to a master server at 127.8.5.254:32943
I20260809 03:24:11.412528 19082 heartbeater.cc:464] Registering TS with master...
I20260809 03:24:11.412673 19082 heartbeater.cc:511] Master 127.8.5.254:32943 requested a full tablet report, sending...
I20260809 03:24:11.413077 18602 ts_manager.cc:194] Registered new tserver with Master: 80749d0e4bdf42d5a9dbb80ac27ec24a (127.8.5.195:41359)
I20260809 03:24:11.416240 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 18942
I20260809 03:24:11.416311 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:24:11.416455 8215 external_mini_cluster.cc:1428] Setting key f7cba6821981134f0c50039240fa8a42
I20260809 03:24:11.417377 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 03:24:11.419301 18641 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:24:11.418725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58466 (local address 127.8.5.254:32943)
0809 03:24:11.418814 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:11.418816 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:11.418913 (+ 97us) server_negotiation.cc:407] Connection header received
0809 03:24:11.419022 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:11.419023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:11.419028 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:11.419083 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:11.419233 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58466: BlockingRecv error: recv got EOF from 127.0.0.1:58466 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 03:24:11.419636 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 18663
I20260809 03:24:11.431025 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 18802
I20260809 03:24:11.438951 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 18942
I20260809 03:24:11.444526 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 18570
2026-08-09T03:24:11Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (566 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:24:11 dist-test-slave-2w3w krb5kdc[19095](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:24:11 dist-test-slave-2w3w krb5kdc[19095](info): set up 2 sockets
Aug 09 03:24:11 dist-test-slave-2w3w krb5kdc[19095](info): commencing operation
krb5kdc: starting...
W20260809 03:24:12.542198 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:24:12 dist-test-slave-2w3w krb5kdc[19095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:24:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:24:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:24:12.666386 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:34035
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:41189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:34035
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:24:12.748340 19109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:24:12.748579 19109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:24:12.748616 19109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:24:12.749758 19109 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:24:12.749827 19109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:24:12.749912 19109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:24:12.749948 19109 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:24:12.749976 19109 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:24:12.751543 19109 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:41189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:34035
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:34035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:24:12.751808 19109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:24:12.752049 19109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:24:12.756891 19114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:12.756887 19118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:12.756927 19115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:24:12.757241 19109 server_base.cc:1034] running on GCE node
I20260809 03:24:12.757486 19109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:24:12.757786 19109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:24:12.759011 19109 hybrid_clock.cc:648] HybridClock initialized: now 1786245852759015 us; error 50 us; skew 500 ppm
Aug 09 03:24:12 dist-test-slave-2w3w krb5kdc[19095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245852, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:24:12.761565 19109 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:24:12.762053 19109 webserver.cc:460] Webserver started at http://127.8.5.254:39667/ using document root <none> and password file <none>
I20260809 03:24:12.762301 19109 fs_manager.cc:359] Metadata directory not provided
I20260809 03:24:12.762374 19109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:24:12.762522 19109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:24:12.763648 19109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "c0fdf0f3c6d6442c8a3d8cbfe0c8a851"
format_stamp: "Formatted at 2026-08-09 03:24:12 on dist-test-slave-2w3w"
server_key: "0cee087bdd5cfd9abb81cb4c667be9ec"
server_key_iv: "33364d1a18b0174706d32ed3f2252757"
server_key_version: "encryptionkey@0"
I20260809 03:24:12.764029 19109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "c0fdf0f3c6d6442c8a3d8cbfe0c8a851"
format_stamp: "Formatted at 2026-08-09 03:24:12 on dist-test-slave-2w3w"
server_key: "0cee087bdd5cfd9abb81cb4c667be9ec"
server_key_iv: "33364d1a18b0174706d32ed3f2252757"
server_key_version: "encryptionkey@0"
I20260809 03:24:12.765357 19109 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:24:12.766280 19125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:12.766470 19109 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:24:12.766577 19109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "c0fdf0f3c6d6442c8a3d8cbfe0c8a851"
format_stamp: "Formatted at 2026-08-09 03:24:12 on dist-test-slave-2w3w"
server_key: "0cee087bdd5cfd9abb81cb4c667be9ec"
server_key_iv: "33364d1a18b0174706d32ed3f2252757"
server_key_version: "encryptionkey@0"
I20260809 03:24:12.766654 19109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:24:12.781807 19109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:24:12.783876 19109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:24:12.784051 19109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:24:12.788192 19109 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:34035
I20260809 03:24:12.788228 19180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:34035 every 8 connection(s)
I20260809 03:24:12.788618 19109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:24:12.789584 19181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:24:12.791481 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 19109
I20260809 03:24:12.791577 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:24:12.791749 8215 external_mini_cluster.cc:1428] Setting key 26c42251f776d7b091abe1664c51c3c6
I20260809 03:24:12.792351 19181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851: Bootstrap starting.
I20260809 03:24:12.793004 19181 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851: Neither blocks nor log segments found. Creating new log.
I20260809 03:24:12.793344 19181 log.cc:824] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851: Log is configured to *not* fsync() on all Append() calls
I20260809 03:24:12.794112 19181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851: No bootstrap required, opened a new log
I20260809 03:24:12.796295 19181 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0fdf0f3c6d6442c8a3d8cbfe0c8a851" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 34035 } }
I20260809 03:24:12.796432 19181 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:24:12.796454 19181 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fdf0f3c6d6442c8a3d8cbfe0c8a851, State: Initialized, Role: FOLLOWER
I20260809 03:24:12.796662 19181 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0fdf0f3c6d6442c8a3d8cbfe0c8a851" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 34035 } }
I20260809 03:24:12.796777 19181 raft_consensus.cc:388] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:24:12.796823 19181 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:24:12.796854 19181 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:24:12.797608 19181 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0fdf0f3c6d6442c8a3d8cbfe0c8a851" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 34035 } }
I20260809 03:24:12.797734 19181 leader_election.cc:302] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c0fdf0f3c6d6442c8a3d8cbfe0c8a851; no voters:
I20260809 03:24:12.797919 19181 leader_election.cc:288] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:24:12.798008 19187 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:24:12.798193 19181 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:24:12.798206 19187 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851 [term 1 LEADER]: Becoming Leader. State: Replica: c0fdf0f3c6d6442c8a3d8cbfe0c8a851, State: Running, Role: LEADER
I20260809 03:24:12.798478 19187 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0fdf0f3c6d6442c8a3d8cbfe0c8a851" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 34035 } }
Aug 09 03:24:12 dist-test-slave-2w3w krb5kdc[19095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:24:12.799016 19188 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c0fdf0f3c6d6442c8a3d8cbfe0c8a851" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0fdf0f3c6d6442c8a3d8cbfe0c8a851" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 34035 } } }
I20260809 03:24:12.799075 19188 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851 [sys.catalog]: This master's current role is: LEADER
I20260809 03:24:12.798893 19189 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0fdf0f3c6d6442c8a3d8cbfe0c8a851. Latest consensus state: current_term: 1 leader_uuid: "c0fdf0f3c6d6442c8a3d8cbfe0c8a851" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0fdf0f3c6d6442c8a3d8cbfe0c8a851" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 34035 } } }
I20260809 03:24:12.799264 19189 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851 [sys.catalog]: This master's current role is: LEADER
I20260809 03:24:12.799654 19196 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:24:12.800532 19196 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:24:12.802076 19196 catalog_manager.cc:1347] Generated new cluster ID: 7002f39faef643b1a0f57a0ed26b2db6
I20260809 03:24:12.802134 19196 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:24:12.803543 19185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:12.792307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54754 (local address 127.8.5.254:34035)
0809 03:24:12.792478 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:12.792488 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:12.792520 (+ 32us) server_negotiation.cc:407] Connection header received
0809 03:24:12.792939 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:12.792944 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:12.792987 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:12.793156 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:12.793963 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:12.794902 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:12.796018 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:12.796417 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:12.796545 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:12.799559 (+ 3014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:24:12.799563 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:24:12.799563 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:24:12.799576 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:24:12.801570 (+ 1994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:12.801972 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:12.801976 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:12.801977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:12.802085 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:12.802321 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:12.802322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:12.802323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:12.802595 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:24:12.802712 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:12.803188 (+ 476us) server_negotiation.cc:299] Negotiation successful
0809 03:24:12.803331 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":86,"threads_started":1}
I20260809 03:24:12.811638 19196 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:24:12.812207 19196 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:24:12.821684 19196 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851: Generated new TSK 0
I20260809 03:24:12.821921 19196 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
I20260809 03:24:12.848253 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:34035
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:41189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:24:12.930787 19209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:24:12.931092 19209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:24:12.931135 19209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:24:12.932319 19209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:24:12.932389 19209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:24:12.932436 19209 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:24:12.934373 19209 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:41189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:34035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19209
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:24:12.934635 19209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:24:12.934904 19209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:24:12.939877 19218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:12.939832 19214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:12.939920 19215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:24:12.940070 19209 server_base.cc:1034] running on GCE node
I20260809 03:24:12.940281 19209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:24:12.940570 19209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:24:12.941742 19209 hybrid_clock.cc:648] HybridClock initialized: now 1786245852941733 us; error 37 us; skew 500 ppm
Aug 09 03:24:12 dist-test-slave-2w3w krb5kdc[19095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245852, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:24:12.944298 19209 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:24:12.944720 19209 webserver.cc:460] Webserver started at http://127.8.5.193:44241/ using document root <none> and password file <none>
I20260809 03:24:12.944950 19209 fs_manager.cc:359] Metadata directory not provided
I20260809 03:24:12.945019 19209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:24:12.945169 19209 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:24:12.946197 19209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "e84e4466160b43e28377620f65afb324"
format_stamp: "Formatted at 2026-08-09 03:24:12 on dist-test-slave-2w3w"
server_key: "12b5d9f4bc9eb8698936f9253fa77a90"
server_key_iv: "e48b38a8da319057771f8df0537b532d"
server_key_version: "encryptionkey@0"
I20260809 03:24:12.946568 19209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "e84e4466160b43e28377620f65afb324"
format_stamp: "Formatted at 2026-08-09 03:24:12 on dist-test-slave-2w3w"
server_key: "12b5d9f4bc9eb8698936f9253fa77a90"
server_key_iv: "e48b38a8da319057771f8df0537b532d"
server_key_version: "encryptionkey@0"
I20260809 03:24:12.947961 19209 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:24:12.948709 19227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:12.948899 19209 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:12.949002 19209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "e84e4466160b43e28377620f65afb324"
format_stamp: "Formatted at 2026-08-09 03:24:12 on dist-test-slave-2w3w"
server_key: "12b5d9f4bc9eb8698936f9253fa77a90"
server_key_iv: "e48b38a8da319057771f8df0537b532d"
server_key_version: "encryptionkey@0"
I20260809 03:24:12.949088 19209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:24:12.973124 19209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:24:12.975528 19209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:24:12.975708 19209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:24:12.975980 19209 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:24:12.976320 19209 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:24:12.976383 19209 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:12.976418 19209 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:24:12.976449 19209 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:12.982347 19209 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:42955
I20260809 03:24:12.982406 19348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:42955 every 8 connection(s)
I20260809 03:24:12.982784 19209 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:24:12.984025 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 19209
I20260809 03:24:12.984133 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:24:12.984314 8215 external_mini_cluster.cc:1428] Setting key 389ff3de96b49243a31cd30f158d50ba
Aug 09 03:24:12 dist-test-slave-2w3w krb5kdc[19095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245852, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.5.194@KRBTEST.COM; defaulting to no policy
I20260809 03:24:12.992902 19185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:12.983611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:60925 (local address 127.8.5.254:34035)
0809 03:24:12.983681 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:12.983683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:12.983911 (+ 228us) server_negotiation.cc:407] Connection header received
0809 03:24:12.984481 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:12.984482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:12.984496 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:12.984573 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:12.985619 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:12.986378 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:12.987467 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:12.987698 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:12.987788 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:12.989992 (+ 2204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:24:12.989993 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:24:12.989993 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:24:12.990001 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:24:12.991486 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:12.991895 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:12.991896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:12.991897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:12.991963 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:12.992233 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:12.992235 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:12.992235 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:12.992358 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:24:12.992444 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:12.992714 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 03:24:12.992804 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 03:24:12.993111 19351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:12.983590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:34035 (local address 127.8.5.193:60925)
0809 03:24:12.983762 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:12.983807 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:12.984363 (+ 556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:12.984653 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:12.984662 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:12.985317 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:12.985516 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:12.985520 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:12.986476 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:12.986477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:12.987371 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:12.987373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:12.987801 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:12.987802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:12.987943 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:12.988504 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:12.988512 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:12.989874 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:24:12.991580 (+ 1706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:24:12.991587 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:24:12.991590 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:24:12.991816 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:24:12.992034 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:24:12.992035 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:24:12.992036 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:24:12.992143 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:24:12.992433 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:24:12.992440 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:24:12.992582 (+ 142us) client_negotiation.cc:769] Sending connection context
0809 03:24:12.992694 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 03:24:12.992856 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":99,"threads_started":1}
I20260809 03:24:12.993677 19349 heartbeater.cc:347] Connected to a master server at 127.8.5.254:34035
I20260809 03:24:12.993793 19349 heartbeater.cc:464] Registering TS with master...
I20260809 03:24:12.993983 19349 heartbeater.cc:511] Master 127.8.5.254:34035 requested a full tablet report, sending...
I20260809 03:24:12.994519 19142 ts_manager.cc:194] Registered new tserver with Master: e84e4466160b43e28377620f65afb324 (127.8.5.193:42955)
I20260809 03:24:12.995179 19142 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:60925
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
I20260809 03:24:13.011457 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:34035
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:41189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:24:13.095618 19354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:24:13.095822 19354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:24:13.095852 19354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:24:13.096925 19354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:24:13.096957 19354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:24:13.096982 19354 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:24:13.098331 19354 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:41189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:34035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:24:13.098588 19354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:24:13.098783 19354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:24:13.103865 19359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:13.103876 19362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:13.103876 19360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:24:13.104045 19354 server_base.cc:1034] running on GCE node
I20260809 03:24:13.104315 19354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:24:13.104557 19354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:24:13.105724 19354 hybrid_clock.cc:648] HybridClock initialized: now 1786245853105703 us; error 38 us; skew 500 ppm
Aug 09 03:24:13 dist-test-slave-2w3w krb5kdc[19095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245853, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:24:13.108305 19354 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:24:13.108767 19354 webserver.cc:460] Webserver started at http://127.8.5.194:35187/ using document root <none> and password file <none>
I20260809 03:24:13.108994 19354 fs_manager.cc:359] Metadata directory not provided
I20260809 03:24:13.109061 19354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:24:13.109211 19354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:24:13.110239 19354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "1eb664fcba914ae5bdebb8ba4c0f5f57"
format_stamp: "Formatted at 2026-08-09 03:24:13 on dist-test-slave-2w3w"
server_key: "9791c2c76b567692193d81dfea28513f"
server_key_iv: "fbd5cfcc7563a329b042e1775f3332aa"
server_key_version: "encryptionkey@0"
I20260809 03:24:13.110599 19354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "1eb664fcba914ae5bdebb8ba4c0f5f57"
format_stamp: "Formatted at 2026-08-09 03:24:13 on dist-test-slave-2w3w"
server_key: "9791c2c76b567692193d81dfea28513f"
server_key_iv: "fbd5cfcc7563a329b042e1775f3332aa"
server_key_version: "encryptionkey@0"
I20260809 03:24:13.112004 19354 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:24:13.112699 19369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:13.112885 19354 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:13.112988 19354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "1eb664fcba914ae5bdebb8ba4c0f5f57"
format_stamp: "Formatted at 2026-08-09 03:24:13 on dist-test-slave-2w3w"
server_key: "9791c2c76b567692193d81dfea28513f"
server_key_iv: "fbd5cfcc7563a329b042e1775f3332aa"
server_key_version: "encryptionkey@0"
I20260809 03:24:13.113061 19354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:24:13.121348 19354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:24:13.123597 19354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:24:13.123759 19354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:24:13.123991 19354 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:24:13.124289 19354 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:24:13.124338 19354 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:13.124370 19354 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:24:13.124400 19354 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:13.130354 19354 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:33461
I20260809 03:24:13.130411 19490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:33461 every 8 connection(s)
I20260809 03:24:13.130710 19354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:24:13.136744 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 19354
Aug 09 03:24:13 dist-test-slave-2w3w krb5kdc[19095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245853, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:24:13.136830 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:24:13.137029 8215 external_mini_cluster.cc:1428] Setting key bdbbe8ed417c5cb83317abf5c0027b15
I20260809 03:24:13.140285 19185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:13.131443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:54331 (local address 127.8.5.254:34035)
0809 03:24:13.131512 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:13.131514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:13.131726 (+ 212us) server_negotiation.cc:407] Connection header received
0809 03:24:13.132271 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:13.132273 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:13.132286 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:13.132358 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:13.133286 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.133800 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.134833 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.135121 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.135208 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:13.137382 (+ 2174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:24:13.137384 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:24:13.137384 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:24:13.137391 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:24:13.138834 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:13.139288 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:13.139289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:13.139289 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:13.139360 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:13.139614 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:13.139616 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:13.139616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:13.139738 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:24:13.139815 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:13.140101 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 03:24:13.140194 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 03:24:13.140457 19493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:13.131426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:34035 (local address 127.8.5.194:54331)
0809 03:24:13.131605 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:13.131640 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:13.132163 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:13.132421 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:13.132430 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:13.132997 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:13.133183 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:13.133188 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.133902 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.133903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:13.134709 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:13.134711 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.135220 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.135221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:13.135341 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:13.135763 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:13.135770 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:13.137240 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:24:13.138940 (+ 1700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:24:13.138948 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:24:13.138950 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:24:13.139206 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:24:13.139430 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:24:13.139431 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:24:13.139431 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:24:13.139544 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:24:13.139806 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:24:13.139813 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:24:13.139959 (+ 146us) client_negotiation.cc:769] Sending connection context
0809 03:24:13.140065 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 03:24:13.140223 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":92,"threads_started":1}
I20260809 03:24:13.140916 19491 heartbeater.cc:347] Connected to a master server at 127.8.5.254:34035
I20260809 03:24:13.141024 19491 heartbeater.cc:464] Registering TS with master...
I20260809 03:24:13.141206 19491 heartbeater.cc:511] Master 127.8.5.254:34035 requested a full tablet report, sending...
I20260809 03:24:13.141594 19142 ts_manager.cc:194] Registered new tserver with Master: 1eb664fcba914ae5bdebb8ba4c0f5f57 (127.8.5.194:33461)
I20260809 03:24:13.142122 19142 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:54331
WARNING: no policy specified for kudu/127.8.5.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
I20260809 03:24:13.161580 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:34035
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:41189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:24:13.242360 19496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:24:13.242559 19496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:24:13.242583 19496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:24:13.243651 19496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:24:13.243685 19496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:24:13.243710 19496 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:24:13.245056 19496 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:41189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:34035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19496
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:24:13.245229 19496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:24:13.245398 19496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:24:13.250316 19502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:13.250324 19501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:13.250324 19504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:24:13.250584 19496 server_base.cc:1034] running on GCE node
I20260809 03:24:13.250837 19496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:24:13.251106 19496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:24:13.252246 19496 hybrid_clock.cc:648] HybridClock initialized: now 1786245853252227 us; error 37 us; skew 500 ppm
Aug 09 03:24:13 dist-test-slave-2w3w krb5kdc[19095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245853, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:24:13.254784 19496 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:24:13.255285 19496 webserver.cc:460] Webserver started at http://127.8.5.195:38155/ using document root <none> and password file <none>
I20260809 03:24:13.255507 19496 fs_manager.cc:359] Metadata directory not provided
I20260809 03:24:13.255575 19496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:24:13.255724 19496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:24:13.256733 19496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "7ab203bd2b3b42498d92ce4045fb73bc"
format_stamp: "Formatted at 2026-08-09 03:24:13 on dist-test-slave-2w3w"
server_key: "ca25771332fab9b17a66485b0fd499d0"
server_key_iv: "da749782df0f42ec6e7a59a9bb1aff9d"
server_key_version: "encryptionkey@0"
I20260809 03:24:13.257097 19496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "7ab203bd2b3b42498d92ce4045fb73bc"
format_stamp: "Formatted at 2026-08-09 03:24:13 on dist-test-slave-2w3w"
server_key: "ca25771332fab9b17a66485b0fd499d0"
server_key_iv: "da749782df0f42ec6e7a59a9bb1aff9d"
server_key_version: "encryptionkey@0"
I20260809 03:24:13.258368 19496 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:24:13.259080 19511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:13.259263 19496 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:24:13.259361 19496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "7ab203bd2b3b42498d92ce4045fb73bc"
format_stamp: "Formatted at 2026-08-09 03:24:13 on dist-test-slave-2w3w"
server_key: "ca25771332fab9b17a66485b0fd499d0"
server_key_iv: "da749782df0f42ec6e7a59a9bb1aff9d"
server_key_version: "encryptionkey@0"
I20260809 03:24:13.259445 19496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:24:13.270087 19496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:24:13.272763 19496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:24:13.272930 19496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:24:13.273146 19496 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:24:13.273463 19496 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:24:13.273516 19496 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:13.273558 19496 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:24:13.273586 19496 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:13.279210 19496 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:44673
I20260809 03:24:13.279295 19638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:44673 every 8 connection(s)
I20260809 03:24:13.279606 19496 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
Aug 09 03:24:13 dist-test-slave-2w3w krb5kdc[19095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245853, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:24:13.286608 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 19496
I20260809 03:24:13.286728 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:24:13.286970 8215 external_mini_cluster.cc:1428] Setting key e00f5d3918d0939b504c627125feb3fa
I20260809 03:24:13.288777 19185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:13.280376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:37015 (local address 127.8.5.254:34035)
0809 03:24:13.280429 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:13.280432 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:13.280661 (+ 229us) server_negotiation.cc:407] Connection header received
0809 03:24:13.281140 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:13.281142 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:13.281153 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:13.281214 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:13.282133 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.282631 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.283730 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.283918 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.283972 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:13.285944 (+ 1972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:24:13.285945 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:24:13.285945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:24:13.285953 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:24:13.287412 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:13.287821 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:13.287822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:13.287822 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:13.287891 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:13.288144 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:13.288145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:13.288145 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:13.288258 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:24:13.288347 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:13.288608 (+ 261us) server_negotiation.cc:299] Negotiation successful
0809 03:24:13.288685 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:24:13.288983 19641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:13.280347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:34035 (local address 127.8.5.195:37015)
0809 03:24:13.280541 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:13.280577 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:13.281033 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:13.281285 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:13.281288 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:13.281870 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:13.282053 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:13.282057 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.282707 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.282708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:13.283657 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:13.283659 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.283989 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.283990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:13.284084 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:13.284493 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:13.284501 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:13.285863 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:24:13.287497 (+ 1634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:24:13.287504 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:24:13.287506 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:24:13.287728 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:24:13.287962 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:24:13.287963 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:24:13.287963 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:24:13.288069 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:24:13.288338 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:24:13.288345 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:24:13.288479 (+ 134us) client_negotiation.cc:769] Sending connection context
0809 03:24:13.288587 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 03:24:13.288740 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":111,"threads_started":1}
I20260809 03:24:13.289430 19639 heartbeater.cc:347] Connected to a master server at 127.8.5.254:34035
I20260809 03:24:13.289529 19639 heartbeater.cc:464] Registering TS with master...
I20260809 03:24:13.289695 19639 heartbeater.cc:511] Master 127.8.5.254:34035 requested a full tablet report, sending...
I20260809 03:24:13.290056 19142 ts_manager.cc:194] Registered new tserver with Master: 7ab203bd2b3b42498d92ce4045fb73bc (127.8.5.195:44673)
I20260809 03:24:13.290400 19142 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:37015
I20260809 03:24:13.298801 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:24:13.306114 19185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:13.300407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54766 (local address 127.8.5.254:34035)
0809 03:24:13.300454 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:13.300457 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:13.300521 (+ 64us) server_negotiation.cc:407] Connection header received
0809 03:24:13.300577 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:13.300577 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:13.300586 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:13.300633 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:13.301192 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.301663 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.302390 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.302561 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.302609 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:13.303911 (+ 1302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:24:13.303912 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:24:13.303913 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:24:13.303918 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:24:13.305085 (+ 1167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:13.305390 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:13.305391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:13.305391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:13.305439 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:13.305621 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:13.305622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:13.305622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:13.305782 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:24:13.305871 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:13.305962 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 03:24:13.306022 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 03:24:13.307924 19142 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54766:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:24:13.309561 19142 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:24:13.316246 19648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:13.311759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:33461 (local address 127.0.0.1:46918)
0809 03:24:13.312108 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:13.312142 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:13.312199 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:13.312752 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:13.312753 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:13.312755 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:24:13.312859 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:13.312861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.313753 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.313754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:13.315157 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:13.315160 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.315921 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.315922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:13.316001 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:13.316015 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 03:24:13.316113 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 03:24:13.316172 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":32,"thread_start_us":78,"threads_started":1}
I20260809 03:24:13.316258 19652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:13.311944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46918 (local address 127.8.5.194:33461)
0809 03:24:13.312580 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:13.312584 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:13.312593 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:24:13.312630 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:13.312631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:13.312645 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:13.312727 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:24:13.312964 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.313655 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.315270 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.315837 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.315922 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:13.315984 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:13.316131 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 03:24:13.316172 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":78,"threads_started":1}
I20260809 03:24:13.316465 19647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:13.311718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:42955 (local address 127.0.0.1:33348)
0809 03:24:13.312085 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:13.312130 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:13.312195 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:13.312441 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:13.312444 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:13.312446 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:24:13.312517 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:13.312519 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.313835 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.313836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:13.315193 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:13.315195 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.316118 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.316119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:13.316190 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:13.316198 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 03:24:13.316335 (+ 137us) client_negotiation.cc:240] Negotiation successful
0809 03:24:13.316381 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"mutex_wait_us":58,"thread_start_us":60,"threads_started":1}
I20260809 03:24:13.316689 19650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:13.311892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33348 (local address 127.8.5.193:42955)
0809 03:24:13.312059 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:13.312064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:13.312276 (+ 212us) server_negotiation.cc:407] Connection header received
0809 03:24:13.312323 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:13.312326 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:13.312342 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:13.312424 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:24:13.312613 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.313748 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.315255 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.315956 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.316028 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:13.316080 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:13.316568 (+ 488us) server_negotiation.cc:299] Negotiation successful
0809 03:24:13.316611 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":84,"threads_started":1}
I20260809 03:24:13.316977 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:13.311924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:44673 (local address 127.0.0.1:60366)
0809 03:24:13.312105 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:13.312130 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:13.312195 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:13.312819 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:13.312820 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:13.312823 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:24:13.312871 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:13.312873 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.314064 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.314065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:13.315080 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:13.315082 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.316119 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.316120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:13.316190 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:13.316196 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 03:24:13.316247 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 03:24:13.316292 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":9,"thread_start_us":42,"threads_started":1}
I20260809 03:24:13.316658 19653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:13.312039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60366 (local address 127.8.5.195:44673)
0809 03:24:13.312246 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:13.312250 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:13.312261 (+ 11us) server_negotiation.cc:407] Connection header received
0809 03:24:13.312321 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:13.312323 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:13.312338 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:13.312448 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:24:13.312960 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.313973 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.315203 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.315956 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.316028 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:13.316079 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:13.316457 (+ 378us) server_negotiation.cc:299] Negotiation successful
0809 03:24:13.316579 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":97,"threads_started":1}
I20260809 03:24:13.317054 19419 tablet_service.cc:1467] Processing CreateTablet for tablet 56b66c7d3c194a6fa6fc600c965e378c (DEFAULT_TABLE table=test-table [id=2cd2be78b95c45879906dc8446b5f2a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:24:13.317451 19419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56b66c7d3c194a6fa6fc600c965e378c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:24:13.317401 19278 tablet_service.cc:1467] Processing CreateTablet for tablet 56b66c7d3c194a6fa6fc600c965e378c (DEFAULT_TABLE table=test-table [id=2cd2be78b95c45879906dc8446b5f2a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:24:13.317731 19278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56b66c7d3c194a6fa6fc600c965e378c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:24:13.320951 19654 tablet_bootstrap.cc:492] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57: Bootstrap starting.
I20260809 03:24:13.321189 19655 tablet_bootstrap.cc:492] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324: Bootstrap starting.
I20260809 03:24:13.321694 19654 tablet_bootstrap.cc:654] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57: Neither blocks nor log segments found. Creating new log.
I20260809 03:24:13.321636 19563 tablet_service.cc:1467] Processing CreateTablet for tablet 56b66c7d3c194a6fa6fc600c965e378c (DEFAULT_TABLE table=test-table [id=2cd2be78b95c45879906dc8446b5f2a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:24:13.321859 19655 tablet_bootstrap.cc:654] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324: Neither blocks nor log segments found. Creating new log.
I20260809 03:24:13.321962 19563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56b66c7d3c194a6fa6fc600c965e378c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:24:13.322361 19654 log.cc:824] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57: Log is configured to *not* fsync() on all Append() calls
I20260809 03:24:13.322466 19655 log.cc:824] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324: Log is configured to *not* fsync() on all Append() calls
I20260809 03:24:13.323170 19654 tablet_bootstrap.cc:492] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57: No bootstrap required, opened a new log
I20260809 03:24:13.323252 19654 ts_tablet_manager.cc:1397] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:24:13.323293 19655 tablet_bootstrap.cc:492] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324: No bootstrap required, opened a new log
I20260809 03:24:13.323365 19655 ts_tablet_manager.cc:1397] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:24:13.324594 19654 raft_consensus.cc:348] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84e4466160b43e28377620f65afb324" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 42955 } } peers { permanent_uuid: "7ab203bd2b3b42498d92ce4045fb73bc" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44673 } } peers { permanent_uuid: "1eb664fcba914ae5bdebb8ba4c0f5f57" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33461 } }
I20260809 03:24:13.324754 19654 raft_consensus.cc:374] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:24:13.324807 19654 raft_consensus.cc:729] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eb664fcba914ae5bdebb8ba4c0f5f57, State: Initialized, Role: FOLLOWER
I20260809 03:24:13.324921 19654 consensus_queue.cc:260] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84e4466160b43e28377620f65afb324" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 42955 } } peers { permanent_uuid: "7ab203bd2b3b42498d92ce4045fb73bc" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44673 } } peers { permanent_uuid: "1eb664fcba914ae5bdebb8ba4c0f5f57" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33461 } }
I20260809 03:24:13.325205 19654 ts_tablet_manager.cc:1428] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 03:24:13.325213 19491 heartbeater.cc:503] Master 127.8.5.254:34035 was elected leader, sending a full tablet report...
I20260809 03:24:13.325557 19659 tablet_bootstrap.cc:492] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc: Bootstrap starting.
I20260809 03:24:13.325840 19655 raft_consensus.cc:348] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84e4466160b43e28377620f65afb324" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 42955 } } peers { permanent_uuid: "7ab203bd2b3b42498d92ce4045fb73bc" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44673 } } peers { permanent_uuid: "1eb664fcba914ae5bdebb8ba4c0f5f57" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33461 } }
I20260809 03:24:13.326014 19655 raft_consensus.cc:374] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:24:13.326056 19655 raft_consensus.cc:729] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e84e4466160b43e28377620f65afb324, State: Initialized, Role: FOLLOWER
I20260809 03:24:13.326167 19655 consensus_queue.cc:260] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84e4466160b43e28377620f65afb324" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 42955 } } peers { permanent_uuid: "7ab203bd2b3b42498d92ce4045fb73bc" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44673 } } peers { permanent_uuid: "1eb664fcba914ae5bdebb8ba4c0f5f57" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33461 } }
I20260809 03:24:13.326278 19659 tablet_bootstrap.cc:654] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc: Neither blocks nor log segments found. Creating new log.
I20260809 03:24:13.326453 19655 ts_tablet_manager.cc:1428] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 03:24:13.326478 19349 heartbeater.cc:503] Master 127.8.5.254:34035 was elected leader, sending a full tablet report...
I20260809 03:24:13.326864 19659 log.cc:824] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc: Log is configured to *not* fsync() on all Append() calls
I20260809 03:24:13.327663 19659 tablet_bootstrap.cc:492] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc: No bootstrap required, opened a new log
I20260809 03:24:13.327735 19659 ts_tablet_manager.cc:1397] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:24:13.329025 19659 raft_consensus.cc:348] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84e4466160b43e28377620f65afb324" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 42955 } } peers { permanent_uuid: "7ab203bd2b3b42498d92ce4045fb73bc" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44673 } } peers { permanent_uuid: "1eb664fcba914ae5bdebb8ba4c0f5f57" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33461 } }
I20260809 03:24:13.329141 19659 raft_consensus.cc:374] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:24:13.329165 19659 raft_consensus.cc:729] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab203bd2b3b42498d92ce4045fb73bc, State: Initialized, Role: FOLLOWER
I20260809 03:24:13.329296 19659 consensus_queue.cc:260] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84e4466160b43e28377620f65afb324" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 42955 } } peers { permanent_uuid: "7ab203bd2b3b42498d92ce4045fb73bc" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44673 } } peers { permanent_uuid: "1eb664fcba914ae5bdebb8ba4c0f5f57" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33461 } }
I20260809 03:24:13.329533 19659 ts_tablet_manager.cc:1428] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:24:13.329609 19639 heartbeater.cc:503] Master 127.8.5.254:34035 was elected leader, sending a full tablet report...
W20260809 03:24:13.381299 19492 tablet.cc:2369] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 03:24:13.483651 19350 tablet.cc:2369] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 03:24:13.530221 19640 tablet.cc:2369] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:24:13.531283 19660 raft_consensus.cc:482] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:24:13.531400 19660 raft_consensus.cc:504] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84e4466160b43e28377620f65afb324" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 42955 } } peers { permanent_uuid: "7ab203bd2b3b42498d92ce4045fb73bc" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44673 } } peers { permanent_uuid: "1eb664fcba914ae5bdebb8ba4c0f5f57" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33461 } }
I20260809 03:24:13.531713 19660 leader_election.cc:288] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ab203bd2b3b42498d92ce4045fb73bc (127.8.5.195:44673), 1eb664fcba914ae5bdebb8ba4c0f5f57 (127.8.5.194:33461)
I20260809 03:24:13.534691 19653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:13.531993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:56299 (local address 127.8.5.195:44673)
0809 03:24:13.532041 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:13.532043 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:13.532129 (+ 86us) server_negotiation.cc:407] Connection header received
0809 03:24:13.532191 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:13.532192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:13.532206 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:13.532265 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:24:13.532472 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.532967 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.533948 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.534330 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.534393 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:13.534427 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:13.534576 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 03:24:13.534624 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 03:24:13.534704 19664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:13.531915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:44673 (local address 127.8.5.193:56299)
0809 03:24:13.532043 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:13.532056 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:13.532125 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:13.532278 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:13.532279 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:13.532281 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:24:13.532399 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:13.532401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.533045 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.533046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:13.533859 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:13.533861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.534419 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.534420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:13.534495 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:13.534498 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:24:13.534553 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 03:24:13.534605 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":64,"threads_started":1}
I20260809 03:24:13.534760 19652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:13.532008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:53715 (local address 127.8.5.194:33461)
0809 03:24:13.532063 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:13.532066 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:13.532205 (+ 139us) server_negotiation.cc:407] Connection header received
0809 03:24:13.532278 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:13.532279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:13.532292 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:13.532351 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:24:13.532548 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.533015 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.533983 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.534346 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.534432 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:13.534442 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:13.534630 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 03:24:13.534674 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 03:24:13.534729 19663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:13.531915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:33461 (local address 127.8.5.193:53715)
0809 03:24:13.532087 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:13.532120 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:13.532203 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:13.532375 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:13.532375 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:13.532377 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:24:13.532467 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:13.532469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.533110 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.533111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:13.533871 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:13.533873 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.534456 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.534457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:13.534531 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:13.534552 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 03:24:13.534610 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 03:24:13.534646 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":37,"thread_start_us":57,"threads_started":1}
I20260809 03:24:13.535135 19585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b66c7d3c194a6fa6fc600c965e378c" candidate_uuid: "e84e4466160b43e28377620f65afb324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab203bd2b3b42498d92ce4045fb73bc" is_pre_election: true
I20260809 03:24:13.535317 19585 raft_consensus.cc:2454] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e84e4466160b43e28377620f65afb324 in term 0.
I20260809 03:24:13.535377 19440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b66c7d3c194a6fa6fc600c965e378c" candidate_uuid: "e84e4466160b43e28377620f65afb324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eb664fcba914ae5bdebb8ba4c0f5f57" is_pre_election: true
I20260809 03:24:13.535534 19440 raft_consensus.cc:2454] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e84e4466160b43e28377620f65afb324 in term 0.
I20260809 03:24:13.535614 19231 leader_election.cc:302] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab203bd2b3b42498d92ce4045fb73bc, e84e4466160b43e28377620f65afb324; no voters:
I20260809 03:24:13.535753 19660 raft_consensus.cc:2781] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:24:13.535812 19660 raft_consensus.cc:482] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:24:13.535836 19660 raft_consensus.cc:3037] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:24:13.536550 19660 raft_consensus.cc:504] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84e4466160b43e28377620f65afb324" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 42955 } } peers { permanent_uuid: "7ab203bd2b3b42498d92ce4045fb73bc" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44673 } } peers { permanent_uuid: "1eb664fcba914ae5bdebb8ba4c0f5f57" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33461 } }
I20260809 03:24:13.536749 19660 leader_election.cc:288] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [CANDIDATE]: Term 1 election: Requested vote from peers 7ab203bd2b3b42498d92ce4045fb73bc (127.8.5.195:44673), 1eb664fcba914ae5bdebb8ba4c0f5f57 (127.8.5.194:33461)
I20260809 03:24:13.536857 19440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b66c7d3c194a6fa6fc600c965e378c" candidate_uuid: "e84e4466160b43e28377620f65afb324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eb664fcba914ae5bdebb8ba4c0f5f57"
I20260809 03:24:13.536928 19440 raft_consensus.cc:3037] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:24:13.536933 19585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b66c7d3c194a6fa6fc600c965e378c" candidate_uuid: "e84e4466160b43e28377620f65afb324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab203bd2b3b42498d92ce4045fb73bc"
I20260809 03:24:13.537004 19585 raft_consensus.cc:3037] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:24:13.537575 19440 raft_consensus.cc:2454] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e84e4466160b43e28377620f65afb324 in term 1.
I20260809 03:24:13.537783 19228 leader_election.cc:302] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eb664fcba914ae5bdebb8ba4c0f5f57, e84e4466160b43e28377620f65afb324; no voters:
I20260809 03:24:13.537783 19585 raft_consensus.cc:2454] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e84e4466160b43e28377620f65afb324 in term 1.
I20260809 03:24:13.537889 19660 raft_consensus.cc:2781] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:24:13.538065 19660 raft_consensus.cc:686] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [term 1 LEADER]: Becoming Leader. State: Replica: e84e4466160b43e28377620f65afb324, State: Running, Role: LEADER
I20260809 03:24:13.538172 19660 consensus_queue.cc:237] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84e4466160b43e28377620f65afb324" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 42955 } } peers { permanent_uuid: "7ab203bd2b3b42498d92ce4045fb73bc" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44673 } } peers { permanent_uuid: "1eb664fcba914ae5bdebb8ba4c0f5f57" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33461 } }
I20260809 03:24:13.539023 19142 catalog_manager.cc:5495] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 reported cstate change: term changed from 0 to 1, leader changed from <none> to e84e4466160b43e28377620f65afb324 (127.8.5.193). New cstate: current_term: 1 leader_uuid: "e84e4466160b43e28377620f65afb324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84e4466160b43e28377620f65afb324" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 42955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ab203bd2b3b42498d92ce4045fb73bc" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1eb664fcba914ae5bdebb8ba4c0f5f57" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33461 } health_report { overall_health: UNKNOWN } } }
I20260809 03:24:13.544725 19650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:13.542582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33358 (local address 127.8.5.193:42955)
0809 03:24:13.542638 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:13.542640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:13.542650 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:24:13.542698 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:13.542698 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:13.542715 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:13.542765 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:24:13.542891 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.543390 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.544102 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:13.544273 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:13.544321 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:13.544448 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:24:13.544533 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:24:13.544591 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:13.544621 (+ 30us) server_negotiation.cc:299] Negotiation successful
0809 03:24:13.544637 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 03:24:13.546445 19585 raft_consensus.cc:1261] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc [term 1 FOLLOWER]: Refusing update from remote peer e84e4466160b43e28377620f65afb324: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:24:13.546445 19440 raft_consensus.cc:1261] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57 [term 1 FOLLOWER]: Refusing update from remote peer e84e4466160b43e28377620f65afb324: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:24:13.546793 19665 consensus_queue.cc:1035] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eb664fcba914ae5bdebb8ba4c0f5f57" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:24:13.546924 19660 consensus_queue.cc:1035] T 56b66c7d3c194a6fa6fc600c965e378c P e84e4466160b43e28377620f65afb324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab203bd2b3b42498d92ce4045fb73bc" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 44673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:24:13.549216 19668 mvcc.cc:205] Tried to move back new op lower bound from 7316463016123437056 to 7316463016093077504. Current Snapshot: MvccSnapshot[applied={T|T < 7316463016123437056}]
I20260809 03:24:13.549935 19670 mvcc.cc:205] Tried to move back new op lower bound from 7316463016123437056 to 7316463016093077504. Current Snapshot: MvccSnapshot[applied={T|T < 7316463016123437056}]
I20260809 03:24:13.551460 19142 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54766:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:24:13.551549 19142 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54766:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:24:13.552337 19142 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c0fdf0f3c6d6442c8a3d8cbfe0c8a851: Sending DeleteTablet for 3 replicas of tablet 56b66c7d3c194a6fa6fc600c965e378c
I20260809 03:24:13.552675 19563 tablet_service.cc:1514] Processing DeleteTablet for tablet 56b66c7d3c194a6fa6fc600c965e378c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:24:13 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:60366
I20260809 03:24:13.552713 19419 tablet_service.cc:1514] Processing DeleteTablet for tablet 56b66c7d3c194a6fa6fc600c965e378c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:24:13 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:46918
I20260809 03:24:13.552896 19678 tablet_replica.cc:330] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc: stopping tablet replica
I20260809 03:24:13.552938 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 19209
I20260809 03:24:13.553021 19678 raft_consensus.cc:2229] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:24:13.553100 19678 raft_consensus.cc:2258] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:24:13.555145 19678 ts_tablet_manager.cc:1905] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:24:13.556543 19678 ts_tablet_manager.cc:1918] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:24:13.556638 19678 log.cc:1196] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/56b66c7d3c194a6fa6fc600c965e378c
I20260809 03:24:13.556690 19679 tablet_replica.cc:330] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57: stopping tablet replica
I20260809 03:24:13.556798 19679 raft_consensus.cc:2229] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:24:13.556892 19679 raft_consensus.cc:2258] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:24:13.556960 19678 ts_tablet_manager.cc:1939] T 56b66c7d3c194a6fa6fc600c965e378c P 7ab203bd2b3b42498d92ce4045fb73bc: Deleting consensus metadata
I20260809 03:24:13.557293 19679 ts_tablet_manager.cc:1905] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:24:13.557410 19129 catalog_manager.cc:4841] TS 7ab203bd2b3b42498d92ce4045fb73bc (127.8.5.195:44673): tablet 56b66c7d3c194a6fa6fc600c965e378c (table test-table [id=2cd2be78b95c45879906dc8446b5f2a4]) successfully deleted
I20260809 03:24:13.558799 19679 ts_tablet_manager.cc:1918] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:24:13.558876 19679 log.cc:1196] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/56b66c7d3c194a6fa6fc600c965e378c
I20260809 03:24:13.559185 19679 ts_tablet_manager.cc:1939] T 56b66c7d3c194a6fa6fc600c965e378c P 1eb664fcba914ae5bdebb8ba4c0f5f57: Deleting consensus metadata
I20260809 03:24:13.559633 19126 catalog_manager.cc:4841] TS 1eb664fcba914ae5bdebb8ba4c0f5f57 (127.8.5.194:33461): tablet 56b66c7d3c194a6fa6fc600c965e378c (table test-table [id=2cd2be78b95c45879906dc8446b5f2a4]) successfully deleted
W20260809 03:24:13.560986 19129 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.5.193:42955 (error 108)
I20260809 03:24:13.561240 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 19354
I20260809 03:24:13.561580 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:13.561470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:42955 (local address 127.0.0.1:33370)
0809 03:24:13.561516 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:13.561543 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.193:42955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260809 03:24:13.562103 19129 catalog_manager.cc:4584] TS e84e4466160b43e28377620f65afb324 (127.8.5.193:42955): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 56b66c7d3c194a6fa6fc600c965e378c: Network error: Client connection negotiation failed: client connection to 127.8.5.193:42955: connect: Connection refused (error 111)
I20260809 03:24:13.567647 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 19496
I20260809 03:24:13.573962 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 19109
2026-08-09T03:24:13Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2130 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:24:13 dist-test-slave-2w3w krb5kdc[19683](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:24:13 dist-test-slave-2w3w krb5kdc[19683](info): set up 2 sockets
Aug 09 03:24:13 dist-test-slave-2w3w krb5kdc[19683](info): commencing operation
krb5kdc: starting...
W20260809 03:24:14.657353 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:24:14 dist-test-slave-2w3w krb5kdc[19683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:24:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:24:14Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.8.5.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.8.5.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.8.5.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/rangeradmin_127.8.5.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.8.5.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/rangeradmin_127.8.5.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.8.5.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.8.5.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.8.5.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/rangerlookup_127.8.5.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.8.5.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/rangerlookup_127.8.5.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.5.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.8.5.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.5.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/HTTP_127.8.5.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.5.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/HTTP_127.8.5.212@KRBTEST.COM.keytab.
I20260809 03:24:14.819396 8215 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskdTui8C/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/postgres -l logfile start
2026-08-09 03:24:17.269 UTC [19717] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 03:24:17.269 UTC [19717] LOG: listening on IPv4 address "127.8.5.212", port 49249
2026-08-09 03:24:17.272 UTC [19717] LOG: listening on Unix socket "/tmp/.s.PGSQL.49249"
2026-08-09 03:24:17.307 UTC [19720] LOG: database system was shut down at 2026-08-09 03:24:15 UTC
2026-08-09 03:24:17.311 UTC [19717] LOG: database system is ready to accept connections
I20260809 03:24:18.337036 8215 mini_postgres.cc:96] Postgres bound to 49249
2026-08-09 03:24:18.344 UTC [19729] FATAL: database "slave" does not exist
127.8.5.212:49249 - accepting connections
I20260809 03:24:18.344861 8215 mini_ranger.cc:161] Starting Ranger...
I20260809 03:24:18.361047 8215 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 03:24:18.817830 8215 mini_ranger.cc:87] Created ranger Postgres database
I20260809 03:24:18.817919 8215 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ranger-admin
2026-08-09 03:24:19,096 [I] DB FLAVOR :POSTGRES
2026-08-09 03:24:19,097 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 03:24:19,097 [I] Checking connection..
2026-08-09 03:24:19,097 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 03:24:19,355 [I] Checking connection passed.
2026-08-09 03:24:19,355 [I] --------- Verifying version history table ---------
2026-08-09 03:24:19,355 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 03:24:19,609 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 03:24:19,609 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 03:24:19,870 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 03:24:19,871 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 03:24:19,871 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 03:24:20.123 UTC [19797] WARNING: there is no transaction in progress
2026-08-09 03:24:20,130 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 03:24:20,130 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 03:24:20,372 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 03:24:20,373 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 03:24:20,373 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 03:24:20,607 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 03:24:20,866 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-2w3w.c.gcp-upstream.internal','N') ;"
2026-08-09 03:24:21,105 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 03:24:21,344 [I] Table x_portal_user does not exist in database ranger
2026-08-09 03:24:21,345 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 03:24:21,606 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 03:24:21,606 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 03:24:21,865 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 03:24:22,118 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 03:24:22,118 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 03:24:23.073 UTC [19917] WARNING: there is no transaction in progress
2026-08-09 03:24:23.088 UTC [19917] WARNING: there is no transaction in progress
2026-08-09 03:24:23.104 UTC [19917] WARNING: there is no transaction in progress
2026-08-09 03:24:23.120 UTC [19917] WARNING: there is no transaction in progress
2026-08-09 03:24:23.134 UTC [19917] WARNING: there is no transaction in progress
2026-08-09 03:24:23.151 UTC [19917] WARNING: there is no transaction in progress
2026-08-09 03:24:23.203 UTC [19917] WARNING: there is no transaction in progress
2026-08-09 03:24:23.210 UTC [19917] WARNING: there is no transaction in progress
2026-08-09 03:24:23.224 UTC [19917] WARNING: there is no transaction in progress
2026-08-09 03:24:23.233 UTC [19917] WARNING: there is no transaction in progress
2026-08-09 03:24:23.243 UTC [19917] WARNING: there is no transaction in progress
2026-08-09 03:24:23.255 UTC [19917] WARNING: there is no transaction in progress
2026-08-09 03:24:23.265 UTC [19917] WARNING: there is no transaction in progress
2026-08-09 03:24:23.271 UTC [19917] WARNING: there is no transaction in progress
2026-08-09 03:24:23.277 UTC [19917] WARNING: there is no transaction in progress
2026-08-09 03:24:23.283 UTC [19917] WARNING: there is no transaction in progress
2026-08-09 03:24:23,907 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 03:24:23,907 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 03:24:24,166 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 03:24:24,166 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 03:24:24,431 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 03:24:24,432 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 03:24:24,692 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 03:24:24,693 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 03:24:24,923 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 03:24:25,180 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-2w3w.c.gcp-upstream.internal';"
2026-08-09 03:24:25,432 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 03:24:25,432 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 03:24:25,674 [I] DB_PATCHES have already been applied
I20260809 03:24:25.680379 8215 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ranger-admin:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskdTui8C/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 03:24:25.680439 8215 mini_ranger.cc:193] Using host: 127.8.5.212
I20260809 03:24:25.684214 8215 mini_ranger.cc:227] Ranger admin URL: http://127.8.5.212:34901
Aug 09, 2026 3:24:25 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 3:24:25 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 3:24:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 3:24:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 3:24:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 3:24:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 3:24:26 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 03:24:26.819375 8215 mini_ranger.cc:160] Time spent starting Ranger: real 8.475s user 0.005s sys 0.006s
Aug 09, 2026 3:24:47 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 3:24:47 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 09, 2026 3:24:47 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 3:24:47 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 3:24:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 3:24:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 3:24:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 3:24:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 3:24:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 3:24:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 3:24:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 3:24:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 3:24:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 3:24:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 3:24:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 3:24:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 3:24:47 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 3:24:48 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 03:24:48.756549 8215 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.8.5.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.8.5.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.8.5.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/rangerkms_127.8.5.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.8.5.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/rangerkms_127.8.5.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.5.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.8.5.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.5.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/HTTP_127.8.5.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.5.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/HTTP_127.8.5.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 03:24:48 dist-test-slave-2w3w krb5kdc[19683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245888, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 03:24:48.840359 8215 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 03:24:48.850955 8215 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 03:24:49.706326 8215 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 03:24:49.706419 8215 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ranger-kms
I20260809 03:24:49.706439 8215 mini_ranger_kms.cc:227] Using postgres at 127.8.5.212:49249
2026-08-09 03:24:49,939 [I] DB FLAVOR :POSTGRES
2026-08-09 03:24:49,939 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 03:24:49,940 [I] Checking connection
2026-08-09 03:24:49,940 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 03:24:50,207 [I] connection success
2026-08-09 03:24:50,207 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 03:24:50,207 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 03:24:50,207 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 03:24:50,441 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 03:24:50,441 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 03:24:50,441 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 03:24:50,441 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:49249/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 03:24:50,696 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 03:24:51.155681 8215 mini_ranger_kms.cc:310] Created kms service
I20260809 03:24:51.346009 8215 mini_ranger_kms.cc:326] Created kudu user
I20260809 03:24:51.390877 8215 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 03:24:51 dist-test-slave-2w3w krb5kdc[19683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245888, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
I20260809 03:24:51.791270 8215 mini_ranger_kms.cc:384] Added ranger policy
I20260809 03:24:51.791396 8215 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ranger-kms:/tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 03:24:51.791419 8215 mini_ranger_kms.cc:240] Using host: 127.8.5.212
I20260809 03:24:51.795408 8215 mini_ranger_kms.cc:276] Ranger KMS PID: 20113
I20260809 03:24:51.795552 8215 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.8.5.212:39413
Aug 09, 2026 3:24:52 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 3:24:52 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 3:24:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 3:24:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 3:24:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 3:24:53 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260809 03:24:54.085491 8215 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.245s user 0.009s sys 0.206s
I20260809 03:24:54.085611 8215 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 03:24:54.085703 8215 mini_ranger_kms.cc:401] 127.8.5.212:39413/kms/v1/keys
Aug 09 03:24:54 dist-test-slave-2w3w krb5kdc[19683](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786245894, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.5.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 09 03:24:54 dist-test-slave-2w3w krb5kdc[19683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245894, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.5.212@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
Aug 09 03:24:54 dist-test-slave-2w3w krb5kdc[19683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245894, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.5.212@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
Aug 09 03:24:57 dist-test-slave-2w3w krb5kdc[19683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:24:57.269951 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:39959
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:42575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:39959
--ranger_config_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.5.212:39413/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:24:57.352587 20172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:24:57.352814 20172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:24:57.352849 20172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:24:57.353940 20172 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:24:57.354004 20172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:24:57.354030 20172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:24:57.354061 20172 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:24:57.354094 20172 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:24:57.355726 20172 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:42575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/master-0/wal
--ranger_kms_url=127.8.5.212:39413/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:39959
--ranger_config_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:39959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:24:57.356019 20172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:24:57.356245 20172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:24:57.361395 20178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:57.361575 20181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:57.361454 20179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:24:57.361498 20172 server_base.cc:1034] running on GCE node
I20260809 03:24:57.361954 20172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:24:57.362249 20172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:24:57.363412 20172 hybrid_clock.cc:648] HybridClock initialized: now 1786245897363404 us; error 32 us; skew 500 ppm
Aug 09 03:24:57 dist-test-slave-2w3w krb5kdc[19683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245897, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:24:57.366245 20172 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:24:57.366693 20172 webserver.cc:460] Webserver started at http://127.8.5.254:34129/ using document root <none> and password file <none>
I20260809 03:24:57.366928 20172 fs_manager.cc:359] Metadata directory not provided
I20260809 03:24:57.367008 20172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:24:57.367158 20172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 03:24:57 dist-test-slave-2w3w krb5kdc[19683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245897, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
I20260809 03:24:57.429656 20172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "a3d6dc8626694133a7ece6eacfb688f0"
format_stamp: "Formatted at 2026-08-09 03:24:57 on dist-test-slave-2w3w"
server_key: "26689c0b16db2a7e36f3a1d654f5ac3f"
server_key_iv: "148b92014270fe47c2a29b0cd784dc5e"
server_key_version: "kuduclusterkey@0"
I20260809 03:24:57.430187 20172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "a3d6dc8626694133a7ece6eacfb688f0"
format_stamp: "Formatted at 2026-08-09 03:24:57 on dist-test-slave-2w3w"
server_key: "26689c0b16db2a7e36f3a1d654f5ac3f"
server_key_iv: "148b92014270fe47c2a29b0cd784dc5e"
server_key_version: "kuduclusterkey@0"
I20260809 03:24:57.432047 20172 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260809 03:24:57.445439 20188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:57.445716 20172 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 03:24:57.445891 20172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "a3d6dc8626694133a7ece6eacfb688f0"
format_stamp: "Formatted at 2026-08-09 03:24:57 on dist-test-slave-2w3w"
server_key: "26689c0b16db2a7e36f3a1d654f5ac3f"
server_key_iv: "148b92014270fe47c2a29b0cd784dc5e"
server_key_version: "kuduclusterkey@0"
I20260809 03:24:57.446009 20172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:24:57.470691 20172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:24:57.473076 20172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:24:57.473259 20172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:24:57.479514 20172 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:39959
I20260809 03:24:57.479609 20242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:39959 every 8 connection(s)
I20260809 03:24:57.479957 20172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:24:57.480798 20243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:24:57.483160 20243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0: Bootstrap starting.
I20260809 03:24:57.483839 20243 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0: Neither blocks nor log segments found. Creating new log.
I20260809 03:24:57.484189 20243 log.cc:824] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0: Log is configured to *not* fsync() on all Append() calls
I20260809 03:24:57.484879 20243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0: No bootstrap required, opened a new log
I20260809 03:24:57.485867 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 20172
I20260809 03:24:57.485986 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:24:57.486171 8215 external_mini_cluster.cc:1428] Setting key 0c42b6213cf100541cd98bfc7edf8615
I20260809 03:24:57.487691 20243 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d6dc8626694133a7ece6eacfb688f0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 39959 } }
I20260809 03:24:57.487950 20243 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:24:57.488029 20243 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3d6dc8626694133a7ece6eacfb688f0, State: Initialized, Role: FOLLOWER
I20260809 03:24:57.488198 20243 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d6dc8626694133a7ece6eacfb688f0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 39959 } }
I20260809 03:24:57.488296 20243 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:24:57.488353 20243 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:24:57.488425 20243 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:24:57.489126 20243 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d6dc8626694133a7ece6eacfb688f0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 39959 } }
I20260809 03:24:57.489241 20243 leader_election.cc:302] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3d6dc8626694133a7ece6eacfb688f0; no voters:
I20260809 03:24:57.489454 20243 leader_election.cc:288] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:24:57.489503 20248 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:24:57.489717 20248 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0 [term 1 LEADER]: Becoming Leader. State: Replica: a3d6dc8626694133a7ece6eacfb688f0, State: Running, Role: LEADER
I20260809 03:24:57.489802 20243 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:24:57.489878 20248 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d6dc8626694133a7ece6eacfb688f0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 39959 } }
I20260809 03:24:57.490242 20248 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3d6dc8626694133a7ece6eacfb688f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d6dc8626694133a7ece6eacfb688f0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 39959 } } }
I20260809 03:24:57.490350 20248 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0 [sys.catalog]: This master's current role is: LEADER
I20260809 03:24:57.490513 20248 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3d6dc8626694133a7ece6eacfb688f0. Latest consensus state: current_term: 1 leader_uuid: "a3d6dc8626694133a7ece6eacfb688f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d6dc8626694133a7ece6eacfb688f0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 39959 } } }
I20260809 03:24:57.490588 20248 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0 [sys.catalog]: This master's current role is: LEADER
I20260809 03:24:57.491694 20254 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:24:57.491750 20243 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 03:24:57.492245 20254 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 03:24:57 dist-test-slave-2w3w krb5kdc[19683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:24:57.500022 20247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:57.486727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58798 (local address 127.8.5.254:39959)
0809 03:24:57.486979 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:57.486989 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:57.487028 (+ 39us) server_negotiation.cc:407] Connection header received
0809 03:24:57.487649 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:57.487658 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:57.487718 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:57.487863 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:57.488593 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:57.490026 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:57.491247 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:57.492072 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:57.495762 (+ 3690us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:57.496129 (+ 367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:24:57.496134 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:24:57.496134 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:24:57.496145 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:24:57.498156 (+ 2011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:57.498533 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:57.498536 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:57.498537 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:57.498666 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:57.498914 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:57.498915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:57.498915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:57.499232 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:24:57.499403 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:57.499499 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 03:24:57.499780 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":160,"threads_started":1}
I20260809 03:24:57.500269 20254 catalog_manager.cc:1347] Generated new cluster ID: c9852c52dbd94639a6bd9329e55191f3
I20260809 03:24:57.500370 20254 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:24:57.510505 20254 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:24:57.511307 20254 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:24:57.518447 20254 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0: Generated new TSK 0
I20260809 03:24:57.518666 20254 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
I20260809 03:24:58.300028 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.5.212:39413/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:39959
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:42575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:24:58.424440 20292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:24:58.424670 20292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:24:58.424710 20292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:24:58.425982 20292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:24:58.426050 20292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:24:58.426095 20292 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:24:58.427776 20292 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:42575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.8.5.212:39413/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:39959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:24:58.428042 20292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:24:58.428293 20292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:24:58.435678 20300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:58.435809 20297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:58.435770 20298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:24:58.436124 20292 server_base.cc:1034] running on GCE node
I20260809 03:24:58.436364 20292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:24:58.436616 20292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:24:58.437774 20292 hybrid_clock.cc:648] HybridClock initialized: now 1786245898437751 us; error 43 us; skew 500 ppm
Aug 09 03:24:58 dist-test-slave-2w3w krb5kdc[19683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245898, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:24:58.440392 20292 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:24:58.440943 20292 webserver.cc:460] Webserver started at http://127.8.5.193:36961/ using document root <none> and password file <none>
I20260809 03:24:58.441185 20292 fs_manager.cc:359] Metadata directory not provided
I20260809 03:24:58.441252 20292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:24:58.441408 20292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 03:24:58 dist-test-slave-2w3w krb5kdc[19683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245898, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
I20260809 03:24:58.453969 20292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "8d2bd171826240bbaa6632becfc7735b"
format_stamp: "Formatted at 2026-08-09 03:24:58 on dist-test-slave-2w3w"
server_key: "147768458d96168cf3cb91b0bf81446f"
server_key_iv: "0603c967a8c2e324f3ac8117350c16a3"
server_key_version: "kuduclusterkey@0"
I20260809 03:24:58.454456 20292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "8d2bd171826240bbaa6632becfc7735b"
format_stamp: "Formatted at 2026-08-09 03:24:58 on dist-test-slave-2w3w"
server_key: "147768458d96168cf3cb91b0bf81446f"
server_key_iv: "0603c967a8c2e324f3ac8117350c16a3"
server_key_version: "kuduclusterkey@0"
I20260809 03:24:58.456326 20292 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260809 03:24:58.474066 20307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:58.474309 20292 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:24:58.474443 20292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "8d2bd171826240bbaa6632becfc7735b"
format_stamp: "Formatted at 2026-08-09 03:24:58 on dist-test-slave-2w3w"
server_key: "147768458d96168cf3cb91b0bf81446f"
server_key_iv: "0603c967a8c2e324f3ac8117350c16a3"
server_key_version: "kuduclusterkey@0"
I20260809 03:24:58.474576 20292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:24:58.516980 20292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:24:58.519189 20292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:24:58.519361 20292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:24:58.519626 20292 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:24:58.520064 20292 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:24:58.520118 20292 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:58.520151 20292 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:24:58.520211 20292 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:58.528469 20292 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:45325
I20260809 03:24:58.528963 20292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:24:58.529220 20431 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:45325 every 8 connection(s)
I20260809 03:24:58.533097 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 20292
I20260809 03:24:58.533202 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:24:58.533433 8215 external_mini_cluster.cc:1428] Setting key 3e5d426fa7bc3ca6d9e1bb9a95ab6e45
Aug 09 03:24:58 dist-test-slave-2w3w krb5kdc[19683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245898, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:24:58.543233 20435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:58.530491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:44227 (local address 127.8.5.254:39959)
0809 03:24:58.531067 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:58.531069 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:58.531082 (+ 13us) server_negotiation.cc:407] Connection header received
0809 03:24:58.531256 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:58.531257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:58.531270 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:58.531338 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:58.532169 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:58.533002 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:58.536014 (+ 3012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:58.536309 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:58.536376 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:58.539247 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:24:58.539249 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:24:58.539249 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:24:58.539256 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:24:58.541351 (+ 2095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:58.541903 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:58.541904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:58.541905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:58.541972 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:58.542296 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:58.542297 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:58.542297 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:58.542444 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:24:58.542514 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:58.543021 (+ 507us) server_negotiation.cc:299] Negotiation successful
0809 03:24:58.543107 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":62,"threads_started":1}
I20260809 03:24:58.543412 20434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:58.530133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:39959 (local address 127.8.5.193:44227)
0809 03:24:58.530370 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:58.530422 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:58.531140 (+ 718us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:58.531425 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:58.531431 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:58.531728 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:58.532059 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:58.532067 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:58.533643 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:58.533644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:58.535911 (+ 2267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:58.535914 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:58.536442 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:58.536443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:58.536583 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:58.537345 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:58.537355 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:58.539134 (+ 1779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:24:58.541472 (+ 2338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:24:58.541479 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:24:58.541482 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:24:58.541795 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:24:58.542051 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:24:58.542052 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:24:58.542052 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:24:58.542198 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:24:58.542526 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:24:58.542533 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:24:58.542805 (+ 272us) client_negotiation.cc:769] Sending connection context
0809 03:24:58.542939 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 03:24:58.543130 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":138,"threads_started":1}
I20260809 03:24:58.544112 20432 heartbeater.cc:347] Connected to a master server at 127.8.5.254:39959
I20260809 03:24:58.544224 20432 heartbeater.cc:464] Registering TS with master...
I20260809 03:24:58.544425 20432 heartbeater.cc:511] Master 127.8.5.254:39959 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.5.194@KRBTEST.COM; defaulting to no policy
I20260809 03:24:58.544934 20207 ts_manager.cc:194] Registered new tserver with Master: 8d2bd171826240bbaa6632becfc7735b (127.8.5.193:45325)
I20260809 03:24:58.545502 20207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:44227
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
I20260809 03:24:58.565618 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.5.212:39413/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:39959
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:42575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 03:24:58 dist-test-slave-2w3w krb5kdc[19683](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786245898, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 03:24:58.689744 20438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:24:58.690116 20438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:24:58.690182 20438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:24:58.692145 20438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:24:58.692214 20438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:24:58.692271 20438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:24:58.694767 20438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:42575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.8.5.212:39413/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:39959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:24:58.695076 20438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:24:58.695395 20438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:24:58.700932 20446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:58.701047 20447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:58.701506 20449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:24:58.701627 20438 server_base.cc:1034] running on GCE node
I20260809 03:24:58.701858 20438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:24:58.702097 20438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:24:58.705364 20438 hybrid_clock.cc:648] HybridClock initialized: now 1786245898705326 us; error 49 us; skew 500 ppm
Aug 09 03:24:58 dist-test-slave-2w3w krb5kdc[19683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245898, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:24:58.708345 20438 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:24:58.708968 20438 webserver.cc:460] Webserver started at http://127.8.5.194:34841/ using document root <none> and password file <none>
I20260809 03:24:58.709324 20438 fs_manager.cc:359] Metadata directory not provided
I20260809 03:24:58.709455 20438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:24:58.709652 20438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 03:24:58 dist-test-slave-2w3w krb5kdc[19683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245898, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
I20260809 03:24:58.727562 20438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "1428403478834edbb9b7dfcae9b4ae3d"
format_stamp: "Formatted at 2026-08-09 03:24:58 on dist-test-slave-2w3w"
server_key: "2c73b990077285721cfa342d493c6cc4"
server_key_iv: "de79b3cfcfa6ba1b676b04a306d38d0a"
server_key_version: "kuduclusterkey@0"
I20260809 03:24:58.728077 20438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "1428403478834edbb9b7dfcae9b4ae3d"
format_stamp: "Formatted at 2026-08-09 03:24:58 on dist-test-slave-2w3w"
server_key: "2c73b990077285721cfa342d493c6cc4"
server_key_iv: "de79b3cfcfa6ba1b676b04a306d38d0a"
server_key_version: "kuduclusterkey@0"
I20260809 03:24:58.730759 20438 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260809 03:24:58.747769 20457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:58.747946 20438 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.000s sys 0.000s
I20260809 03:24:58.748028 20438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "1428403478834edbb9b7dfcae9b4ae3d"
format_stamp: "Formatted at 2026-08-09 03:24:58 on dist-test-slave-2w3w"
server_key: "2c73b990077285721cfa342d493c6cc4"
server_key_iv: "de79b3cfcfa6ba1b676b04a306d38d0a"
server_key_version: "kuduclusterkey@0"
I20260809 03:24:58.748121 20438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:24:58.779198 20438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:24:58.781749 20438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:24:58.782037 20438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:24:58.782351 20438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:24:58.782757 20438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:24:58.782850 20438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:58.782927 20438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:24:58.782979 20438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:58.789851 20438 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:38841
I20260809 03:24:58.790444 20438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:24:58.792620 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 20438
I20260809 03:24:58.792737 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:24:58.792940 8215 external_mini_cluster.cc:1428] Setting key 065993ba2d58af5836d01e07631646ee
I20260809 03:24:58.793067 20583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:38841 every 8 connection(s)
WARNING: no policy specified for kudu/127.8.5.195@KRBTEST.COM; defaulting to no policy
Aug 09 03:24:58 dist-test-slave-2w3w krb5kdc[19683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245898, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:24:58.815174 20586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:58.794086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:39959 (local address 127.8.5.194:57035)
0809 03:24:58.794476 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:58.794533 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:58.795449 (+ 916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:58.795811 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:58.795815 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:58.796090 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:58.796357 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:58.796363 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:58.797380 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:58.797381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:58.798646 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:58.798650 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:58.799322 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:58.799323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:58.809075 (+ 9752us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:58.809678 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:58.809689 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:58.811469 (+ 1780us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:24:58.813438 (+ 1969us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:24:58.813445 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:24:58.813448 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:24:58.813755 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:24:58.813980 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:24:58.813981 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:24:58.813981 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:24:58.814116 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:24:58.814402 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:24:58.814407 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:24:58.814582 (+ 175us) client_negotiation.cc:769] Sending connection context
0809 03:24:58.814691 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 03:24:58.814901 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":87,"threads_started":1}
I20260809 03:24:58.815809 20435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:58.794354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:57035 (local address 127.8.5.254:39959)
0809 03:24:58.794398 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:58.794400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:58.794670 (+ 270us) server_negotiation.cc:407] Connection header received
0809 03:24:58.795576 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:58.795577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:58.795591 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:58.795624 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:58.796468 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:58.797262 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:58.798756 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:58.799162 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:58.799213 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:58.811583 (+ 12370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:24:58.811585 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:24:58.811585 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:24:58.811592 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:24:58.813317 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:58.813858 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:58.813859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:58.813860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:58.813917 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:58.814184 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:58.814185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:58.814186 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:58.814320 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:24:58.814377 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:58.815606 (+ 1229us) server_negotiation.cc:299] Negotiation successful
0809 03:24:58.815700 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:24:58.816197 20584 heartbeater.cc:347] Connected to a master server at 127.8.5.254:39959
I20260809 03:24:58.816311 20584 heartbeater.cc:464] Registering TS with master...
I20260809 03:24:58.816514 20584 heartbeater.cc:511] Master 127.8.5.254:39959 requested a full tablet report, sending...
I20260809 03:24:58.816999 20207 ts_manager.cc:194] Registered new tserver with Master: 1428403478834edbb9b7dfcae9b4ae3d (127.8.5.194:38841)
I20260809 03:24:58.817513 20207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:57035
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
I20260809 03:24:58.835944 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.5.212:39413/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:39959
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:42575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:24:58.959697 20590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:24:58.960009 20590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:24:58.960047 20590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:24:58.961728 20590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:24:58.961793 20590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:24:58.961830 20590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:24:58.963976 20590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:42575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.8.5.212:39413/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:39959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:24:58.964221 20590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:24:58.964465 20590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:24:58.970920 20598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:58.970916 20596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:24:58.971213 20595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:24:58.971242 20590 server_base.cc:1034] running on GCE node
I20260809 03:24:58.971469 20590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:24:58.971719 20590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:24:58.972894 20590 hybrid_clock.cc:648] HybridClock initialized: now 1786245898972874 us; error 35 us; skew 500 ppm
Aug 09 03:24:58 dist-test-slave-2w3w krb5kdc[19683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245898, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:24:58.975781 20590 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:24:58.976222 20590 webserver.cc:460] Webserver started at http://127.8.5.195:37219/ using document root <none> and password file <none>
I20260809 03:24:58.976452 20590 fs_manager.cc:359] Metadata directory not provided
I20260809 03:24:58.976521 20590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:24:58.976665 20590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 03:24:58 dist-test-slave-2w3w krb5kdc[19683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245898, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
I20260809 03:24:58.990846 20590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "436e81e0b8954685b80d52f93989f0d6"
format_stamp: "Formatted at 2026-08-09 03:24:58 on dist-test-slave-2w3w"
server_key: "db83536527644f50e4f2d3ba2f332ebb"
server_key_iv: "278057a69dc07409a0ffa0984c88f17e"
server_key_version: "kuduclusterkey@0"
I20260809 03:24:58.991436 20590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "436e81e0b8954685b80d52f93989f0d6"
format_stamp: "Formatted at 2026-08-09 03:24:58 on dist-test-slave-2w3w"
server_key: "db83536527644f50e4f2d3ba2f332ebb"
server_key_iv: "278057a69dc07409a0ffa0984c88f17e"
server_key_version: "kuduclusterkey@0"
I20260809 03:24:58.993103 20590 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:24:59.016502 20605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:59.016693 20590 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.000s sys 0.000s
I20260809 03:24:59.016798 20590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "436e81e0b8954685b80d52f93989f0d6"
format_stamp: "Formatted at 2026-08-09 03:24:58 on dist-test-slave-2w3w"
server_key: "db83536527644f50e4f2d3ba2f332ebb"
server_key_iv: "278057a69dc07409a0ffa0984c88f17e"
server_key_version: "kuduclusterkey@0"
I20260809 03:24:59.016901 20590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:24:59.026436 20590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:24:59.028877 20590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:24:59.029045 20590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:24:59.029314 20590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:24:59.029667 20590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:24:59.029712 20590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:59.029759 20590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:24:59.029778 20590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:24:59.037778 20590 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:42497
I20260809 03:24:59.038105 20728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:42497 every 8 connection(s)
I20260809 03:24:59.038254 20590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:24:59.044691 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 20590
I20260809 03:24:59.044812 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:24:59.045020 8215 external_mini_cluster.cc:1428] Setting key f1a9794f0d4e657aced8f99005190491
Aug 09 03:24:59 dist-test-slave-2w3w krb5kdc[19683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245898, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:24:59.053882 20435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:59.039019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:48763 (local address 127.8.5.254:39959)
0809 03:24:59.039068 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:59.039070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:59.039307 (+ 237us) server_negotiation.cc:407] Connection header received
0809 03:24:59.039870 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:59.039871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:59.039884 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:59.039957 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:59.040545 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.041048 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.042291 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.042597 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.042643 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:59.049267 (+ 6624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:24:59.049269 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:24:59.049269 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:24:59.049277 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:24:59.052028 (+ 2751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:59.052670 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:59.052671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:59.052671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:59.052733 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:59.053059 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:59.053060 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:59.053060 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:59.053216 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:24:59.053265 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:59.053681 (+ 416us) server_negotiation.cc:299] Negotiation successful
0809 03:24:59.053774 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 03:24:59.054524 20731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:59.039025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:39959 (local address 127.8.5.195:48763)
0809 03:24:59.039178 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:59.039218 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:59.039758 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:59.040026 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:59.040030 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:59.040248 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:24:59.040443 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:59.040448 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.041146 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.041147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:59.042179 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:59.042182 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.042745 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.042746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:59.042890 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:59.043541 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:24:59.043551 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:24:59.049032 (+ 5481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:24:59.052161 (+ 3129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:24:59.052168 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:24:59.052170 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:24:59.052572 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:24:59.052841 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:24:59.052842 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:24:59.052842 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:24:59.052983 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:24:59.053321 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:24:59.053337 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:24:59.053509 (+ 172us) client_negotiation.cc:769] Sending connection context
0809 03:24:59.054235 (+ 726us) client_negotiation.cc:240] Negotiation successful
0809 03:24:59.054366 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":83,"threads_started":1}
I20260809 03:24:59.055130 20729 heartbeater.cc:347] Connected to a master server at 127.8.5.254:39959
I20260809 03:24:59.055244 20729 heartbeater.cc:464] Registering TS with master...
I20260809 03:24:59.055433 20729 heartbeater.cc:511] Master 127.8.5.254:39959 requested a full tablet report, sending...
I20260809 03:24:59.055814 20207 ts_manager.cc:194] Registered new tserver with Master: 436e81e0b8954685b80d52f93989f0d6 (127.8.5.195:42497)
I20260809 03:24:59.056262 20207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:48763
I20260809 03:24:59.061990 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:24:59.070268 20435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:59.063591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51306 (local address 127.8.5.254:39959)
0809 03:24:59.063629 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:59.063631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:59.063763 (+ 132us) server_negotiation.cc:407] Connection header received
0809 03:24:59.063828 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:59.063829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:59.063838 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:59.063879 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:24:59.064416 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.065064 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.065846 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.066053 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.066123 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:59.067532 (+ 1409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:24:59.067534 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:24:59.067534 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:24:59.067541 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:24:59.069132 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:59.069496 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:59.069497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:59.069497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:59.069552 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:24:59.069765 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:24:59.069766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:24:59.069766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:24:59.069878 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:24:59.069980 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:59.070095 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 03:24:59.070168 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 03:24:59.072052 20207 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51306:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:24:59.074067 20207 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:24:59.081771 20742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:59.076604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:42497 (local address 127.0.0.1:55986)
0809 03:24:59.076825 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:59.077474 (+ 649us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:59.077501 (+ 27us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:59.077806 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:59.077809 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:59.077810 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:24:59.077871 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:59.077873 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.079324 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.079325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:59.080504 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:59.080507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.081519 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.081520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:59.081592 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:59.081606 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 03:24:59.081649 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 03:24:59.081702 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":90,"threads_started":1}
I20260809 03:24:59.082391 20746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:59.077105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55986 (local address 127.8.5.195:42497)
0809 03:24:59.077642 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:59.077645 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:59.077652 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:24:59.077678 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:59.077679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:59.077691 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:59.077774 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:24:59.077953 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.079215 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.080679 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.081434 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.082157 (+ 723us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:59.082242 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:59.082268 (+ 26us) server_negotiation.cc:299] Negotiation successful
0809 03:24:59.082309 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":80,"threads_started":1}
I20260809 03:24:59.082892 20744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:59.076865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:45325 (local address 127.0.0.1:42276)
0809 03:24:59.078212 (+ 1347us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:59.078222 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:59.078271 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:59.078566 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:59.078567 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:59.078569 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:24:59.078606 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:59.078608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.080227 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.080228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:59.081383 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:59.081386 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.082672 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.082673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:59.082733 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:59.082739 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 03:24:59.082788 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 03:24:59.082825 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1328,"thread_start_us":67,"threads_started":1}
I20260809 03:24:59.083109 20745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:59.076967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42276 (local address 127.8.5.193:45325)
0809 03:24:59.077580 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:59.077584 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:59.078344 (+ 760us) server_negotiation.cc:407] Connection header received
0809 03:24:59.078382 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:59.078384 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:59.078400 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:59.078465 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:24:59.078676 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.080151 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.081487 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.082523 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.082583 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:59.082638 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:59.083001 (+ 363us) server_negotiation.cc:299] Negotiation successful
0809 03:24:59.083041 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":55,"threads_started":1}
I20260809 03:24:59.083214 20656 tablet_service.cc:1467] Processing CreateTablet for tablet 735a284e1f4f41c782e61d7c2245b808 (DEFAULT_TABLE table=test-table [id=86d5a7a3dddf474bb52e75857de4a7fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:24:59.083580 20656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 735a284e1f4f41c782e61d7c2245b808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:24:59.087505 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:59.076631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:38841 (local address 127.0.0.1:47952)
0809 03:24:59.077286 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:59.077338 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:59.077402 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:59.083500 (+ 6098us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:59.083501 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:59.083503 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:24:59.083541 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:59.083543 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.084861 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.084862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:59.085992 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:59.085995 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.087289 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.087290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:59.087366 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:59.087372 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 03:24:59.087404 (+ 32us) client_negotiation.cc:240] Negotiation successful
0809 03:24:59.087439 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":74,"threads_started":1}
I20260809 03:24:59.087734 20360 tablet_service.cc:1467] Processing CreateTablet for tablet 735a284e1f4f41c782e61d7c2245b808 (DEFAULT_TABLE table=test-table [id=86d5a7a3dddf474bb52e75857de4a7fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:24:59.087881 20747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:59.077180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47952 (local address 127.8.5.194:38841)
0809 03:24:59.083313 (+ 6133us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:59.083317 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:59.083327 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:24:59.083371 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:59.083372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:59.083388 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:59.083616 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:24:59.083693 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.084737 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.086404 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.087195 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.087659 (+ 464us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:59.087742 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:59.087769 (+ 27us) server_negotiation.cc:299] Negotiation successful
0809 03:24:59.087805 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6083,"thread_start_us":131,"threads_started":1}
I20260809 03:24:59.088093 20360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 735a284e1f4f41c782e61d7c2245b808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:24:59.091575 20509 tablet_service.cc:1467] Processing CreateTablet for tablet 735a284e1f4f41c782e61d7c2245b808 (DEFAULT_TABLE table=test-table [id=86d5a7a3dddf474bb52e75857de4a7fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:24:59.091925 20509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 735a284e1f4f41c782e61d7c2245b808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:24:59.092195 20749 tablet_bootstrap.cc:492] T 735a284e1f4f41c782e61d7c2245b808 P 8d2bd171826240bbaa6632becfc7735b: Bootstrap starting.
I20260809 03:24:59.093199 20749 tablet_bootstrap.cc:654] T 735a284e1f4f41c782e61d7c2245b808 P 8d2bd171826240bbaa6632becfc7735b: Neither blocks nor log segments found. Creating new log.
I20260809 03:24:59.093588 20749 log.cc:824] T 735a284e1f4f41c782e61d7c2245b808 P 8d2bd171826240bbaa6632becfc7735b: Log is configured to *not* fsync() on all Append() calls
I20260809 03:24:59.093827 20748 tablet_bootstrap.cc:492] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6: Bootstrap starting.
I20260809 03:24:59.095132 20748 tablet_bootstrap.cc:654] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6: Neither blocks nor log segments found. Creating new log.
I20260809 03:24:59.095607 20748 log.cc:824] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6: Log is configured to *not* fsync() on all Append() calls
I20260809 03:24:59.096413 20749 tablet_bootstrap.cc:492] T 735a284e1f4f41c782e61d7c2245b808 P 8d2bd171826240bbaa6632becfc7735b: No bootstrap required, opened a new log
I20260809 03:24:59.096530 20749 ts_tablet_manager.cc:1397] T 735a284e1f4f41c782e61d7c2245b808 P 8d2bd171826240bbaa6632becfc7735b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 03:24:59.099117 20749 raft_consensus.cc:348] T 735a284e1f4f41c782e61d7c2245b808 P 8d2bd171826240bbaa6632becfc7735b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e81e0b8954685b80d52f93989f0d6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42497 } } peers { permanent_uuid: "8d2bd171826240bbaa6632becfc7735b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45325 } } peers { permanent_uuid: "1428403478834edbb9b7dfcae9b4ae3d" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 38841 } }
I20260809 03:24:59.099274 20749 raft_consensus.cc:374] T 735a284e1f4f41c782e61d7c2245b808 P 8d2bd171826240bbaa6632becfc7735b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:24:59.099318 20749 raft_consensus.cc:729] T 735a284e1f4f41c782e61d7c2245b808 P 8d2bd171826240bbaa6632becfc7735b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d2bd171826240bbaa6632becfc7735b, State: Initialized, Role: FOLLOWER
I20260809 03:24:59.099439 20749 consensus_queue.cc:260] T 735a284e1f4f41c782e61d7c2245b808 P 8d2bd171826240bbaa6632becfc7735b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e81e0b8954685b80d52f93989f0d6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42497 } } peers { permanent_uuid: "8d2bd171826240bbaa6632becfc7735b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45325 } } peers { permanent_uuid: "1428403478834edbb9b7dfcae9b4ae3d" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 38841 } }
I20260809 03:24:59.099697 20749 ts_tablet_manager.cc:1428] T 735a284e1f4f41c782e61d7c2245b808 P 8d2bd171826240bbaa6632becfc7735b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 03:24:59.099821 20432 heartbeater.cc:503] Master 127.8.5.254:39959 was elected leader, sending a full tablet report...
I20260809 03:24:59.100680 20748 tablet_bootstrap.cc:492] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6: No bootstrap required, opened a new log
I20260809 03:24:59.100752 20748 ts_tablet_manager.cc:1397] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20260809 03:24:59.102383 20748 raft_consensus.cc:348] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e81e0b8954685b80d52f93989f0d6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42497 } } peers { permanent_uuid: "8d2bd171826240bbaa6632becfc7735b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45325 } } peers { permanent_uuid: "1428403478834edbb9b7dfcae9b4ae3d" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 38841 } }
I20260809 03:24:59.102525 20748 raft_consensus.cc:374] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:24:59.102567 20748 raft_consensus.cc:729] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436e81e0b8954685b80d52f93989f0d6, State: Initialized, Role: FOLLOWER
I20260809 03:24:59.102679 20748 consensus_queue.cc:260] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e81e0b8954685b80d52f93989f0d6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42497 } } peers { permanent_uuid: "8d2bd171826240bbaa6632becfc7735b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45325 } } peers { permanent_uuid: "1428403478834edbb9b7dfcae9b4ae3d" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 38841 } }
I20260809 03:24:59.102929 20748 ts_tablet_manager.cc:1428] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 03:24:59.103052 20729 heartbeater.cc:503] Master 127.8.5.254:39959 was elected leader, sending a full tablet report...
I20260809 03:24:59.104368 20753 tablet_bootstrap.cc:492] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d: Bootstrap starting.
I20260809 03:24:59.105317 20753 tablet_bootstrap.cc:654] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d: Neither blocks nor log segments found. Creating new log.
I20260809 03:24:59.105643 20753 log.cc:824] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d: Log is configured to *not* fsync() on all Append() calls
I20260809 03:24:59.106323 20753 tablet_bootstrap.cc:492] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d: No bootstrap required, opened a new log
I20260809 03:24:59.106400 20753 ts_tablet_manager.cc:1397] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:24:59.108026 20753 raft_consensus.cc:348] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e81e0b8954685b80d52f93989f0d6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42497 } } peers { permanent_uuid: "8d2bd171826240bbaa6632becfc7735b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45325 } } peers { permanent_uuid: "1428403478834edbb9b7dfcae9b4ae3d" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 38841 } }
I20260809 03:24:59.108198 20753 raft_consensus.cc:374] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:24:59.108242 20753 raft_consensus.cc:729] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1428403478834edbb9b7dfcae9b4ae3d, State: Initialized, Role: FOLLOWER
I20260809 03:24:59.108358 20753 consensus_queue.cc:260] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e81e0b8954685b80d52f93989f0d6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42497 } } peers { permanent_uuid: "8d2bd171826240bbaa6632becfc7735b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45325 } } peers { permanent_uuid: "1428403478834edbb9b7dfcae9b4ae3d" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 38841 } }
I20260809 03:24:59.108599 20753 ts_tablet_manager.cc:1428] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:24:59.108701 20584 heartbeater.cc:503] Master 127.8.5.254:39959 was elected leader, sending a full tablet report...
Aug 09 03:24:59 dist-test-slave-2w3w krb5kdc[19683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245898, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
W20260809 03:24:59.284767 20433 tablet.cc:2369] T 735a284e1f4f41c782e61d7c2245b808 P 8d2bd171826240bbaa6632becfc7735b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 03:24:59.289587 20730 tablet.cc:2369] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 03:24:59.293905 20585 tablet.cc:2369] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:24:59.457520 20758 raft_consensus.cc:482] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:24:59.457683 20758 raft_consensus.cc:504] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e81e0b8954685b80d52f93989f0d6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42497 } } peers { permanent_uuid: "8d2bd171826240bbaa6632becfc7735b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45325 } } peers { permanent_uuid: "1428403478834edbb9b7dfcae9b4ae3d" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 38841 } }
I20260809 03:24:59.458084 20758 leader_election.cc:288] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 436e81e0b8954685b80d52f93989f0d6 (127.8.5.195:42497), 8d2bd171826240bbaa6632becfc7735b (127.8.5.193:45325)
I20260809 03:24:59.462855 20745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:59.458602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:44325 (local address 127.8.5.193:45325)
0809 03:24:59.458838 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:59.458841 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:59.459137 (+ 296us) server_negotiation.cc:407] Connection header received
0809 03:24:59.459246 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:59.459247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:59.459259 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:59.459298 (+ 39us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:24:59.459521 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.460010 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.461730 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.462408 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.462463 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:59.462473 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:59.462705 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 03:24:59.462779 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208}
I20260809 03:24:59.463092 20762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:59.458494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:45325 (local address 127.8.5.194:44325)
0809 03:24:59.459071 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:59.459082 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:59.459169 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:59.459375 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:59.459375 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:59.459377 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:24:59.459445 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:59.459448 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.460275 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.460276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:59.461562 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:59.461566 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.462534 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.462535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:59.462617 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:59.462621 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:24:59.462945 (+ 324us) client_negotiation.cc:240] Negotiation successful
0809 03:24:59.463011 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":38,"threads_started":1}
I20260809 03:24:59.463533 20380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "735a284e1f4f41c782e61d7c2245b808" candidate_uuid: "1428403478834edbb9b7dfcae9b4ae3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d2bd171826240bbaa6632becfc7735b" is_pre_election: true
I20260809 03:24:59.463708 20380 raft_consensus.cc:2454] T 735a284e1f4f41c782e61d7c2245b808 P 8d2bd171826240bbaa6632becfc7735b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1428403478834edbb9b7dfcae9b4ae3d in term 0.
I20260809 03:24:59.464005 20461 leader_election.cc:302] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1428403478834edbb9b7dfcae9b4ae3d, 8d2bd171826240bbaa6632becfc7735b; no voters:
I20260809 03:24:59.464133 20758 raft_consensus.cc:2781] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:24:59.464170 20758 raft_consensus.cc:482] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:24:59.464190 20758 raft_consensus.cc:3037] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:24:59.465080 20758 raft_consensus.cc:504] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e81e0b8954685b80d52f93989f0d6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42497 } } peers { permanent_uuid: "8d2bd171826240bbaa6632becfc7735b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45325 } } peers { permanent_uuid: "1428403478834edbb9b7dfcae9b4ae3d" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 38841 } }
I20260809 03:24:59.465202 20758 leader_election.cc:288] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [CANDIDATE]: Term 1 election: Requested vote from peers 436e81e0b8954685b80d52f93989f0d6 (127.8.5.195:42497), 8d2bd171826240bbaa6632becfc7735b (127.8.5.193:45325)
I20260809 03:24:59.465653 20380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "735a284e1f4f41c782e61d7c2245b808" candidate_uuid: "1428403478834edbb9b7dfcae9b4ae3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d2bd171826240bbaa6632becfc7735b"
I20260809 03:24:59.465728 20380 raft_consensus.cc:3037] T 735a284e1f4f41c782e61d7c2245b808 P 8d2bd171826240bbaa6632becfc7735b [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:24:59.466580 20380 raft_consensus.cc:2454] T 735a284e1f4f41c782e61d7c2245b808 P 8d2bd171826240bbaa6632becfc7735b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1428403478834edbb9b7dfcae9b4ae3d in term 1.
I20260809 03:24:59.466804 20461 leader_election.cc:302] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1428403478834edbb9b7dfcae9b4ae3d, 8d2bd171826240bbaa6632becfc7735b; no voters:
I20260809 03:24:59.466915 20758 raft_consensus.cc:2781] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:24:59.467083 20758 raft_consensus.cc:686] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [term 1 LEADER]: Becoming Leader. State: Replica: 1428403478834edbb9b7dfcae9b4ae3d, State: Running, Role: LEADER
I20260809 03:24:59.467171 20758 consensus_queue.cc:237] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e81e0b8954685b80d52f93989f0d6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42497 } } peers { permanent_uuid: "8d2bd171826240bbaa6632becfc7735b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45325 } } peers { permanent_uuid: "1428403478834edbb9b7dfcae9b4ae3d" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 38841 } }
I20260809 03:24:59.467944 20207 catalog_manager.cc:5495] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1428403478834edbb9b7dfcae9b4ae3d (127.8.5.194). New cstate: current_term: 1 leader_uuid: "1428403478834edbb9b7dfcae9b4ae3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e81e0b8954685b80d52f93989f0d6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2bd171826240bbaa6632becfc7735b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1428403478834edbb9b7dfcae9b4ae3d" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 38841 } health_report { overall_health: HEALTHY } } }
I20260809 03:24:59.470748 20746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:59.458900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:53693 (local address 127.8.5.195:42497)
0809 03:24:59.459003 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:59.459006 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:59.459016 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:24:59.459044 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:59.459045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:59.459058 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:59.459112 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:24:59.459336 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.460093 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.469854 (+ 9761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.470398 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.470444 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:59.470453 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:59.470647 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 03:24:59.470685 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 03:24:59.471124 20763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:59.458326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:42497 (local address 127.8.5.194:53693)
0809 03:24:59.458669 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:59.458683 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 03:24:59.458755 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:24:59.459174 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:24:59.459175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:24:59.459178 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:24:59.459247 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:59.459249 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.463468 (+ 4219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.463469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:59.469740 (+ 6271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:24:59.469743 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.470515 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.470515 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:24:59.470575 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:59.470578 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:24:59.470989 (+ 411us) client_negotiation.cc:240] Negotiation successful
0809 03:24:59.471034 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":61,"threads_started":1}
I20260809 03:24:59.471558 20680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "735a284e1f4f41c782e61d7c2245b808" candidate_uuid: "1428403478834edbb9b7dfcae9b4ae3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e81e0b8954685b80d52f93989f0d6" is_pre_election: true
I20260809 03:24:59.471720 20680 raft_consensus.cc:2454] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1428403478834edbb9b7dfcae9b4ae3d in term 0.
I20260809 03:24:59.471860 20678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "735a284e1f4f41c782e61d7c2245b808" candidate_uuid: "1428403478834edbb9b7dfcae9b4ae3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e81e0b8954685b80d52f93989f0d6"
I20260809 03:24:59.471923 20678 raft_consensus.cc:3037] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:24:59.472788 20678 raft_consensus.cc:2454] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1428403478834edbb9b7dfcae9b4ae3d in term 1.
Aug 09 03:24:59 dist-test-slave-2w3w krb5kdc[19683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245898, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
I20260809 03:24:59.522851 20747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:59.519341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47964 (local address 127.8.5.194:38841)
0809 03:24:59.519468 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 03:24:59.519469 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:24:59.519477 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:24:59.519519 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:24:59.519520 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:24:59.519544 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:24:59.519604 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:24:59.519835 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.520630 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.521727 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:24:59.522037 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:24:59.522108 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:24:59.522305 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:24:59.522437 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:24:59.522510 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 03:24:59.522721 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 03:24:59.522741 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260809 03:24:59.525151 20380 raft_consensus.cc:1261] T 735a284e1f4f41c782e61d7c2245b808 P 8d2bd171826240bbaa6632becfc7735b [term 1 FOLLOWER]: Refusing update from remote peer 1428403478834edbb9b7dfcae9b4ae3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:24:59.525604 20764 consensus_queue.cc:1035] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2bd171826240bbaa6632becfc7735b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:24:59.527980 20678 raft_consensus.cc:1261] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6 [term 1 FOLLOWER]: Refusing update from remote peer 1428403478834edbb9b7dfcae9b4ae3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:24:59.528324 20764 consensus_queue.cc:1035] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e81e0b8954685b80d52f93989f0d6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:24:59.531749 20767 mvcc.cc:205] Tried to move back new op lower bound from 7316463204451872768 to 7316463204218060800. Current Snapshot: MvccSnapshot[applied={T|T < 7316463204451872768}]
I20260809 03:24:59.535768 20773 mvcc.cc:205] Tried to move back new op lower bound from 7316463204451872768 to 7316463204218060800. Current Snapshot: MvccSnapshot[applied={T|T < 7316463204451872768}]
I20260809 03:24:59.538199 20207 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:24:59.538303 20207 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:24:59.538985 20207 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a3d6dc8626694133a7ece6eacfb688f0: Sending DeleteTablet for 3 replicas of tablet 735a284e1f4f41c782e61d7c2245b808
I20260809 03:24:59.539489 20656 tablet_service.cc:1514] Processing DeleteTablet for tablet 735a284e1f4f41c782e61d7c2245b808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:24:59 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:55986
I20260809 03:24:59.539669 20360 tablet_service.cc:1514] Processing DeleteTablet for tablet 735a284e1f4f41c782e61d7c2245b808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:24:59 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:42276
I20260809 03:24:59.539853 20509 tablet_service.cc:1514] Processing DeleteTablet for tablet 735a284e1f4f41c782e61d7c2245b808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:24:59 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:47952
I20260809 03:24:59.540565 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 20292
I20260809 03:24:59.544365 20777 tablet_replica.cc:330] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6: stopping tablet replica
I20260809 03:24:59.544510 20777 raft_consensus.cc:2229] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:24:59.544677 20777 raft_consensus.cc:2258] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:24:59.549149 20779 tablet_replica.cc:330] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d: stopping tablet replica
I20260809 03:24:59.549245 20779 raft_consensus.cc:2229] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:24:59.549405 20779 raft_consensus.cc:2258] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:24:59.549940 20777 ts_tablet_manager.cc:1905] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:24:59.551730 20777 ts_tablet_manager.cc:1918] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:24:59.551877 20777 log.cc:1196] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/735a284e1f4f41c782e61d7c2245b808
I20260809 03:24:59.552484 20777 ts_tablet_manager.cc:1939] T 735a284e1f4f41c782e61d7c2245b808 P 436e81e0b8954685b80d52f93989f0d6: Deleting consensus metadata
I20260809 03:24:59.553395 20191 catalog_manager.cc:4841] TS 436e81e0b8954685b80d52f93989f0d6 (127.8.5.195:42497): tablet 735a284e1f4f41c782e61d7c2245b808 (table test-table [id=86d5a7a3dddf474bb52e75857de4a7fe]) successfully deleted
I20260809 03:24:59.555255 20779 ts_tablet_manager.cc:1905] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:24:59.560914 20779 ts_tablet_manager.cc:1918] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:24:59.560999 20779 log.cc:1196] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/735a284e1f4f41c782e61d7c2245b808
I20260809 03:24:59.561254 20779 ts_tablet_manager.cc:1939] T 735a284e1f4f41c782e61d7c2245b808 P 1428403478834edbb9b7dfcae9b4ae3d: Deleting consensus metadata
I20260809 03:24:59.561661 20192 catalog_manager.cc:4841] TS 1428403478834edbb9b7dfcae9b4ae3d (127.8.5.194:38841): tablet 735a284e1f4f41c782e61d7c2245b808 (table test-table [id=86d5a7a3dddf474bb52e75857de4a7fe]) successfully deleted
W20260809 03:24:59.563472 20191 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.5.193:45325 (error 108)
I20260809 03:24:59.564124 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 20438
I20260809 03:24:59.569557 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:24:59.568515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:45325 (local address 127.0.0.1:42280)
0809 03:24:59.569438 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0809 03:24:59.569515 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.193:45325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":894}
W20260809 03:24:59.572227 20191 catalog_manager.cc:4584] TS 8d2bd171826240bbaa6632becfc7735b (127.8.5.193:45325): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 735a284e1f4f41c782e61d7c2245b808: Network error: Client connection negotiation failed: client connection to 127.8.5.193:45325: connect: Connection refused (error 111)
I20260809 03:24:59.580677 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 20590
I20260809 03:24:59.587440 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 20172
I20260809 03:24:59.596266 8215 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 03:24:59.950402 8215 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 03:24:59.950503 8215 mini_ranger.cc:66] Stopping Ranger...
I20260809 03:25:00.294500 8215 mini_ranger.cc:68] Stopped Ranger
2026-08-09 03:25:00.294 UTC [19717] LOG: received smart shutdown request
2026-08-09 03:25:00.298 UTC [19717] LOG: background worker "logical replication launcher" (PID 19727) exited with exit code 1
2026-08-09 03:25:00.299 UTC [19721] LOG: shutting down
2026-08-09 03:25:00.458 UTC [19717] LOG: database system is shut down
2026-08-09T03:25:00Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (47000 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:25:00 dist-test-slave-2w3w krb5kdc[20791](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:25:00 dist-test-slave-2w3w krb5kdc[20791](info): set up 2 sockets
Aug 09 03:25:00 dist-test-slave-2w3w krb5kdc[20791](info): commencing operation
krb5kdc: starting...
W20260809 03:25:01.728696 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:25:01 dist-test-slave-2w3w krb5kdc[20791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:25:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:25:01Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.8.5.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.8.5.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.8.5.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/rangeradmin_127.8.5.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.8.5.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/rangeradmin_127.8.5.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.8.5.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.8.5.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.8.5.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/rangerlookup_127.8.5.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.8.5.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/rangerlookup_127.8.5.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.5.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.8.5.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.5.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/HTTP_127.8.5.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.5.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/HTTP_127.8.5.212@KRBTEST.COM.keytab.
I20260809 03:25:01.897076 8215 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskdTui8C/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/postgres -l logfile start
2026-08-09 03:25:04.313 UTC [20822] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 03:25:04.314 UTC [20822] LOG: listening on IPv4 address "127.8.5.212", port 51067
2026-08-09 03:25:04.317 UTC [20822] LOG: listening on Unix socket "/tmp/.s.PGSQL.51067"
2026-08-09 03:25:04.338 UTC [20825] LOG: database system was shut down at 2026-08-09 03:25:02 UTC
2026-08-09 03:25:04.342 UTC [20822] LOG: database system is ready to accept connections
I20260809 03:25:05.328033 8215 mini_postgres.cc:96] Postgres bound to 51067
2026-08-09 03:25:05.335 UTC [20833] FATAL: database "slave" does not exist
127.8.5.212:51067 - accepting connections
I20260809 03:25:05.335741 8215 mini_ranger.cc:161] Starting Ranger...
I20260809 03:25:05.351100 8215 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 03:25:05.825753 8215 mini_ranger.cc:87] Created ranger Postgres database
I20260809 03:25:05.825831 8215 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-admin
2026-08-09 03:25:06,103 [I] DB FLAVOR :POSTGRES
2026-08-09 03:25:06,104 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 03:25:06,104 [I] Checking connection..
2026-08-09 03:25:06,104 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 03:25:06,355 [I] Checking connection passed.
2026-08-09 03:25:06,356 [I] --------- Verifying version history table ---------
2026-08-09 03:25:06,356 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 03:25:06,605 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 03:25:06,606 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 03:25:06,858 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 03:25:06,859 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 03:25:06,859 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 03:25:07.102 UTC [20907] WARNING: there is no transaction in progress
2026-08-09 03:25:07,109 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 03:25:07,110 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 03:25:07,358 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 03:25:07,358 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 03:25:07,358 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 03:25:07,597 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 03:25:07,851 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-2w3w.c.gcp-upstream.internal','N') ;"
2026-08-09 03:25:08,092 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 03:25:08,344 [I] Table x_portal_user does not exist in database ranger
2026-08-09 03:25:08,345 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 03:25:08,601 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 03:25:08,602 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 03:25:08,860 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 03:25:09,116 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 03:25:09,116 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 03:25:10.045 UTC [21021] WARNING: there is no transaction in progress
2026-08-09 03:25:10.060 UTC [21021] WARNING: there is no transaction in progress
2026-08-09 03:25:10.074 UTC [21021] WARNING: there is no transaction in progress
2026-08-09 03:25:10.089 UTC [21021] WARNING: there is no transaction in progress
2026-08-09 03:25:10.104 UTC [21021] WARNING: there is no transaction in progress
2026-08-09 03:25:10.122 UTC [21021] WARNING: there is no transaction in progress
2026-08-09 03:25:10.174 UTC [21021] WARNING: there is no transaction in progress
2026-08-09 03:25:10.180 UTC [21021] WARNING: there is no transaction in progress
2026-08-09 03:25:10.193 UTC [21021] WARNING: there is no transaction in progress
2026-08-09 03:25:10.203 UTC [21021] WARNING: there is no transaction in progress
2026-08-09 03:25:10.212 UTC [21021] WARNING: there is no transaction in progress
2026-08-09 03:25:10.225 UTC [21021] WARNING: there is no transaction in progress
2026-08-09 03:25:10.234 UTC [21021] WARNING: there is no transaction in progress
2026-08-09 03:25:10.240 UTC [21021] WARNING: there is no transaction in progress
2026-08-09 03:25:10.247 UTC [21021] WARNING: there is no transaction in progress
2026-08-09 03:25:10.253 UTC [21021] WARNING: there is no transaction in progress
2026-08-09 03:25:10,865 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 03:25:10,866 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 03:25:11,118 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 03:25:11,119 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 03:25:11,377 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 03:25:11,378 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 03:25:11,614 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 03:25:11,615 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 03:25:11,865 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 03:25:12,113 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-2w3w.c.gcp-upstream.internal';"
2026-08-09 03:25:12,338 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 03:25:12,339 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 03:25:12,650 [I] DB_PATCHES have already been applied
I20260809 03:25:12.656091 8215 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-admin:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskdTui8C/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 03:25:12.656175 8215 mini_ranger.cc:193] Using host: 127.8.5.212
I20260809 03:25:12.660164 8215 mini_ranger.cc:227] Ranger admin URL: http://127.8.5.212:54171
Aug 09, 2026 3:25:13 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 3:25:13 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 3:25:13 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 3:25:13 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 3:25:13 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 3:25:13 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 3:25:13 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 03:25:13.831698 8215 mini_ranger.cc:160] Time spent starting Ranger: real 8.496s user 0.002s sys 0.009s
Aug 09, 2026 3:25:33 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 3:25:33 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 3:25:33 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 3:25:33 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 3:25:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 3:25:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 3:25:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 3:25:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 3:25:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 3:25:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 3:25:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 3:25:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 3:25:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 3:25:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 3:25:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 3:25:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 3:25:33 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 3:25:34 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 03:25:34.586926 8215 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.8.5.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.8.5.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.8.5.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/rangerkms_127.8.5.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.8.5.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/rangerkms_127.8.5.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.5.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.8.5.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.5.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/HTTP_127.8.5.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.5.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/HTTP_127.8.5.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 03:25:34 dist-test-slave-2w3w krb5kdc[20791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245934, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 03:25:34.676658 8215 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 03:25:34.686951 8215 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 03:25:35.575697 8215 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 03:25:35.575784 8215 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-kms
I20260809 03:25:35.575807 8215 mini_ranger_kms.cc:227] Using postgres at 127.8.5.212:51067
2026-08-09 03:25:35,740 [I] DB FLAVOR :POSTGRES
2026-08-09 03:25:35,740 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 03:25:35,740 [I] Checking connection
2026-08-09 03:25:35,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 03:25:35,972 [I] connection success
2026-08-09 03:25:35,972 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 03:25:35,972 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 03:25:35,973 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 03:25:36,214 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 03:25:36,214 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 03:25:36,214 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 03:25:36,214 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.5.212:51067/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 03:25:36,470 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 03:25:36.939359 8215 mini_ranger_kms.cc:310] Created kms service
I20260809 03:25:37.105588 8215 mini_ranger_kms.cc:326] Created kudu user
I20260809 03:25:37.148131 8215 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 03:25:37 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245934, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
I20260809 03:25:37.527544 8215 mini_ranger_kms.cc:384] Added ranger policy
I20260809 03:25:37.527747 8215 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-kms:/tmp/dist-test-taskdTui8C/build/release/bin/postgresql.jar:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskdTui8C/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 03:25:37.527773 8215 mini_ranger_kms.cc:240] Using host: 127.8.5.212
I20260809 03:25:37.531960 8215 mini_ranger_kms.cc:276] Ranger KMS PID: 21211
I20260809 03:25:37.532048 8215 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.8.5.212:57775
Aug 09, 2026 3:25:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 3:25:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 3:25:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 3:25:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 3:25:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 3:25:38 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 03:25:39 dist-test-slave-2w3w krb5kdc[20791](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786245939, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.5.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:39.883347 8215 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.207s user 0.012s sys 0.137s
I20260809 03:25:39.883450 8215 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 03:25:39.883499 8215 mini_ranger_kms.cc:401] 127.8.5.212:57775/kms/v1/keys
Aug 09 03:25:40 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245939, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.5.212@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
Aug 09 03:25:40 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245939, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.5.212@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
Aug 09 03:25:42 dist-test-slave-2w3w krb5kdc[20791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245942, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:25:42.598429 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:35189
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:40865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:35189
--ranger_config_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.5.212:57775/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:25:42.681262 21267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:42.681514 21267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:42.681555 21267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:42.682744 21267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:25:42.682812 21267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:42.682839 21267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:42.682873 21267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:25:42.682896 21267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:25:42.684638 21267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:40865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/wal
--ranger_kms_url=127.8.5.212:57775/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:35189
--ranger_config_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:35189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:42.684931 21267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:42.685166 21267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:42.691510 21273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:42.691617 21267 server_base.cc:1034] running on GCE node
W20260809 03:25:42.691516 21272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:42.691704 21275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:42.692030 21267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:42.692406 21267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:42.693572 21267 hybrid_clock.cc:648] HybridClock initialized: now 1786245942693548 us; error 40 us; skew 500 ppm
Aug 09 03:25:42 dist-test-slave-2w3w krb5kdc[20791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245942, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:42.696168 21267 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:25:42.696687 21267 webserver.cc:460] Webserver started at http://127.8.5.254:38205/ using document root <none> and password file <none>
I20260809 03:25:42.696923 21267 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:42.696962 21267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:42.697098 21267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 03:25:42 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245942, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
I20260809 03:25:42.759002 21267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "d66c7923a50d4685986464c83d98f9cd"
format_stamp: "Formatted at 2026-08-09 03:25:42 on dist-test-slave-2w3w"
server_key: "417e50d7b104f0828edb71662749fa4e"
server_key_iv: "b98cf0c638e119c71c73816d03ec016e"
server_key_version: "kuduclusterkey@0"
I20260809 03:25:42.759508 21267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "d66c7923a50d4685986464c83d98f9cd"
format_stamp: "Formatted at 2026-08-09 03:25:42 on dist-test-slave-2w3w"
server_key: "417e50d7b104f0828edb71662749fa4e"
server_key_iv: "b98cf0c638e119c71c73816d03ec016e"
server_key_version: "kuduclusterkey@0"
I20260809 03:25:42.761415 21267 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260809 03:25:42.775870 21283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:42.776077 21267 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:25:42.776158 21267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "d66c7923a50d4685986464c83d98f9cd"
format_stamp: "Formatted at 2026-08-09 03:25:42 on dist-test-slave-2w3w"
server_key: "417e50d7b104f0828edb71662749fa4e"
server_key_iv: "b98cf0c638e119c71c73816d03ec016e"
server_key_version: "kuduclusterkey@0"
I20260809 03:25:42.776239 21267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:42.788838 21267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:42.790380 21267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:42.790491 21267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:42.794639 21267 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:35189
I20260809 03:25:42.794689 21341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:35189 every 8 connection(s)
I20260809 03:25:42.795099 21267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:25:42.795753 21342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:25:42.798058 21342 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd: Bootstrap starting.
I20260809 03:25:42.798867 21342 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd: Neither blocks nor log segments found. Creating new log.
I20260809 03:25:42.799260 21342 log.cc:824] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:42.800045 21342 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd: No bootstrap required, opened a new log
I20260809 03:25:42.802294 21342 raft_consensus.cc:348] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d66c7923a50d4685986464c83d98f9cd" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35189 } }
I20260809 03:25:42.802479 21342 raft_consensus.cc:374] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:25:42.802536 21342 raft_consensus.cc:729] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d66c7923a50d4685986464c83d98f9cd, State: Initialized, Role: FOLLOWER
I20260809 03:25:42.802719 21342 consensus_queue.cc:260] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d66c7923a50d4685986464c83d98f9cd" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35189 } }
I20260809 03:25:42.802834 21342 raft_consensus.cc:388] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:25:42.802884 21342 raft_consensus.cc:482] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:25:42.802938 21342 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:25:42.803572 21342 raft_consensus.cc:504] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d66c7923a50d4685986464c83d98f9cd" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35189 } }
I20260809 03:25:42.803706 21342 leader_election.cc:302] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d66c7923a50d4685986464c83d98f9cd; no voters:
I20260809 03:25:42.803920 21342 leader_election.cc:288] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:25:42.803983 21345 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:25:42.804219 21345 raft_consensus.cc:686] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [term 1 LEADER]: Becoming Leader. State: Replica: d66c7923a50d4685986464c83d98f9cd, State: Running, Role: LEADER
I20260809 03:25:42.804200 21342 sys_catalog.cc:564] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:25:42.804386 21345 consensus_queue.cc:237] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d66c7923a50d4685986464c83d98f9cd" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35189 } }
I20260809 03:25:42.804790 21347 sys_catalog.cc:455] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader d66c7923a50d4685986464c83d98f9cd. Latest consensus state: current_term: 1 leader_uuid: "d66c7923a50d4685986464c83d98f9cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d66c7923a50d4685986464c83d98f9cd" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35189 } } }
I20260809 03:25:42.804970 21347 sys_catalog.cc:458] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [sys.catalog]: This master's current role is: LEADER
I20260809 03:25:42.805076 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 21267
I20260809 03:25:42.805177 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:25:42.805296 21353 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:25:42.805369 8215 external_mini_cluster.cc:1428] Setting key 6b547afd9b2edaa8a4f15b4c0d63d064
I20260809 03:25:42.804842 21346 sys_catalog.cc:455] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d66c7923a50d4685986464c83d98f9cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d66c7923a50d4685986464c83d98f9cd" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35189 } } }
I20260809 03:25:42.805644 21346 sys_catalog.cc:458] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [sys.catalog]: This master's current role is: LEADER
I20260809 03:25:42.806396 21353 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:25:42.807490 21342 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 03:25:42.811656 21353 catalog_manager.cc:1347] Generated new cluster ID: a05e4ea8159f42c9ba3f3f852140eec5
I20260809 03:25:42.811830 21353 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 03:25:42 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245942, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:25:42.821834 21363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:42.805828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45344 (local address 127.8.5.254:35189)
0809 03:25:42.806361 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:42.806370 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:42.806404 (+ 34us) server_negotiation.cc:407] Connection header received
0809 03:25:42.806516 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:42.806523 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:42.806586 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:42.806739 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:42.807768 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:42.812201 (+ 4433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:42.813373 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:42.814335 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:42.814460 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:42.817533 (+ 3073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:42.817537 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:42.817538 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:42.817550 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:42.819867 (+ 2317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:42.820275 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:42.820279 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:42.820279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:42.820396 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:42.820705 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:42.820707 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:42.820707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:42.821071 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:42.821232 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:42.821375 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 03:25:42.821520 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":478,"thread_start_us":455,"threads_started":1}
I20260809 03:25:42.823236 21353 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:25:42.823897 21353 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:25:42.828465 21353 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd: Generated new TSK 0
I20260809 03:25:42.828640 21353 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
I20260809 03:25:43.549623 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.5.212:57775/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:35189
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:40865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:25:43.651216 21389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:43.651474 21389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:43.651511 21389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:43.652842 21389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:43.652915 21389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:43.652958 21389 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:25:43.654850 21389 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:40865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.8.5.212:57775/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:35189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:43.655117 21389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:43.655373 21389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:43.661643 21397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:43.661935 21389 server_base.cc:1034] running on GCE node
W20260809 03:25:43.662936 21396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:43.663272 21400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:43.663506 21389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:43.663745 21389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:43.664925 21389 hybrid_clock.cc:648] HybridClock initialized: now 1786245943664910 us; error 25 us; skew 500 ppm
Aug 09 03:25:43 dist-test-slave-2w3w krb5kdc[20791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245943, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:43.667464 21389 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:25:43.667860 21389 webserver.cc:460] Webserver started at http://127.8.5.193:33965/ using document root <none> and password file <none>
I20260809 03:25:43.668087 21389 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:43.668155 21389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:43.668303 21389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 03:25:43 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245943, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
I20260809 03:25:43.681404 21389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "3c82bfbb6b03487786fbd7f90f36d21b"
format_stamp: "Formatted at 2026-08-09 03:25:43 on dist-test-slave-2w3w"
server_key: "16b5a89091ccbf80ca7124a65827f818"
server_key_iv: "743136eec58e681b0686aaa91660a34a"
server_key_version: "kuduclusterkey@0"
I20260809 03:25:43.681936 21389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "3c82bfbb6b03487786fbd7f90f36d21b"
format_stamp: "Formatted at 2026-08-09 03:25:43 on dist-test-slave-2w3w"
server_key: "16b5a89091ccbf80ca7124a65827f818"
server_key_iv: "743136eec58e681b0686aaa91660a34a"
server_key_version: "kuduclusterkey@0"
I20260809 03:25:43.683919 21389 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 03:25:43.698400 21410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:43.698668 21389 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:25:43.698779 21389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "3c82bfbb6b03487786fbd7f90f36d21b"
format_stamp: "Formatted at 2026-08-09 03:25:43 on dist-test-slave-2w3w"
server_key: "16b5a89091ccbf80ca7124a65827f818"
server_key_iv: "743136eec58e681b0686aaa91660a34a"
server_key_version: "kuduclusterkey@0"
I20260809 03:25:43.698879 21389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:43.723939 21389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:43.726465 21389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:43.726668 21389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:43.726941 21389 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:25:43.727380 21389 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:25:43.727468 21389 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:43.727571 21389 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:25:43.727648 21389 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:43.734138 21389 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:38751
I20260809 03:25:43.734627 21389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:25:43.738623 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 21389
I20260809 03:25:43.738708 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:25:43.738894 8215 external_mini_cluster.cc:1428] Setting key 3c9f82babbe695aae05b0e8c720dd232
WARNING: no policy specified for kudu/127.8.5.194@KRBTEST.COM; defaulting to no policy
I20260809 03:25:43.755715 21530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:38751 every 8 connection(s)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.194@KRBTEST.COM" created.
Aug 09 03:25:43 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245943, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:25:43.773980 21535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:43.756424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:35189 (local address 127.8.5.193:51499)
0809 03:25:43.763071 (+ 6647us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:43.763139 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:43.763856 (+ 717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:43.764287 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:43.764292 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:43.764554 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:43.764858 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:43.764864 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:43.765861 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:43.765862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:43.767103 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:43.767106 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:43.767633 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:43.767633 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:43.767765 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:43.768455 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:43.768465 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:43.770162 (+ 1697us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:43.772284 (+ 2122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:43.772291 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:43.772293 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:43.772578 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:43.772853 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:43.772854 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:43.772854 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:43.772987 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:43.773296 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:43.773301 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:43.773469 (+ 168us) client_negotiation.cc:769] Sending connection context
0809 03:25:43.773579 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 03:25:43.773728 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6585,"thread_start_us":108,"threads_started":1}
I20260809 03:25:43.774528 21536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:43.756753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:51499 (local address 127.8.5.254:35189)
0809 03:25:43.763464 (+ 6711us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:43.763467 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:43.763480 (+ 13us) server_negotiation.cc:407] Connection header received
0809 03:25:43.764013 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:43.764015 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:43.764031 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:43.764080 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:43.764985 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:43.765744 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:43.767204 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:43.767478 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:43.767526 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:43.770271 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:43.770273 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:43.770273 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:43.770281 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:43.772183 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:43.772666 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:43.772668 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:43.772668 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:43.772731 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:43.773070 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:43.773071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:43.773071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:43.773206 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:43.773267 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:43.774341 (+ 1074us) server_negotiation.cc:299] Negotiation successful
0809 03:25:43.774424 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6677,"thread_start_us":83,"threads_started":1}
I20260809 03:25:43.775381 21531 heartbeater.cc:347] Connected to a master server at 127.8.5.254:35189
I20260809 03:25:43.775481 21531 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:43.775668 21531 heartbeater.cc:511] Master 127.8.5.254:35189 requested a full tablet report, sending...
I20260809 03:25:43.776196 21303 ts_manager.cc:194] Registered new tserver with Master: 3c82bfbb6b03487786fbd7f90f36d21b (127.8.5.193:38751)
I20260809 03:25:43.777067 21303 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:51499
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
I20260809 03:25:43.785959 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.5.212:57775/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:35189
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:40865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 03:25:43 dist-test-slave-2w3w krb5kdc[20791](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786245943, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 03:25:43.907995 21542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:43.908358 21542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:43.908455 21542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:43.910215 21542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:43.910420 21542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:43.910524 21542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:25:43.912854 21542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:40865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.8.5.212:57775/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:35189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:43.913331 21542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:43.913651 21542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:43.920512 21547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:43.921455 21542 server_base.cc:1034] running on GCE node
W20260809 03:25:43.923108 21550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:43.927115 21548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:43.927438 21542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:43.927740 21542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:43.928910 21542 hybrid_clock.cc:648] HybridClock initialized: now 1786245943928887 us; error 38 us; skew 500 ppm
Aug 09 03:25:43 dist-test-slave-2w3w krb5kdc[20791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245943, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:43.932248 21542 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:25:43.932716 21542 webserver.cc:460] Webserver started at http://127.8.5.194:40067/ using document root <none> and password file <none>
I20260809 03:25:43.932957 21542 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:43.933002 21542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:43.933121 21542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 03:25:43 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245943, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
I20260809 03:25:43.949283 21542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "951b1cce09414daa81906c2905ce9d5e"
format_stamp: "Formatted at 2026-08-09 03:25:43 on dist-test-slave-2w3w"
server_key: "1275a35ff2e0d26330509113bcb10254"
server_key_iv: "d2680c05679e6954fe069ad4cc385057"
server_key_version: "kuduclusterkey@0"
I20260809 03:25:43.949808 21542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "951b1cce09414daa81906c2905ce9d5e"
format_stamp: "Formatted at 2026-08-09 03:25:43 on dist-test-slave-2w3w"
server_key: "1275a35ff2e0d26330509113bcb10254"
server_key_iv: "d2680c05679e6954fe069ad4cc385057"
server_key_version: "kuduclusterkey@0"
I20260809 03:25:43.952896 21542 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260809 03:25:43.966572 21558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:43.966885 21542 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:25:43.967033 21542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "951b1cce09414daa81906c2905ce9d5e"
format_stamp: "Formatted at 2026-08-09 03:25:43 on dist-test-slave-2w3w"
server_key: "1275a35ff2e0d26330509113bcb10254"
server_key_iv: "d2680c05679e6954fe069ad4cc385057"
server_key_version: "kuduclusterkey@0"
I20260809 03:25:43.967139 21542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:43.991900 21542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:43.994504 21542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:43.994750 21542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:43.995143 21542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:25:43.995579 21542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:25:43.995666 21542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:43.995741 21542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:25:43.995808 21542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:44.007846 21542 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:39047
I20260809 03:25:44.007920 21679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:39047 every 8 connection(s)
I20260809 03:25:44.008427 21542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:25:44.013013 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 21542
I20260809 03:25:44.013114 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:25:44.013298 8215 external_mini_cluster.cc:1428] Setting key 385f8975d8caf8491a7abb39969b287e
Aug 09 03:25:44 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245943, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:25:44.021495 21536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:44.009198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:52907 (local address 127.8.5.254:35189)
0809 03:25:44.009248 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:44.009250 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:44.009513 (+ 263us) server_negotiation.cc:407] Connection header received
0809 03:25:44.010219 (+ 706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:44.010220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:44.010232 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:44.010293 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:44.011063 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:44.011581 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:44.013019 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:44.013311 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:44.013400 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:44.017946 (+ 4546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:44.017947 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:44.017948 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:44.017956 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:44.019776 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:44.020261 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:44.020263 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:44.020263 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:44.020338 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:44.020672 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:44.020673 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:44.020674 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:44.020812 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:44.020857 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:44.021270 (+ 413us) server_negotiation.cc:299] Negotiation successful
0809 03:25:44.021389 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:25:44.022274 21682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:44.009193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:35189 (local address 127.8.5.194:52907)
0809 03:25:44.009385 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:44.009432 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:44.010110 (+ 678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:44.010368 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:44.010372 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:44.010626 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:44.010916 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:44.010923 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:44.011697 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:44.011698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:44.012924 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:44.012928 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:44.013441 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:44.013442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:44.013581 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:44.016149 (+ 2568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:44.016159 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:44.017857 (+ 1698us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:44.019862 (+ 2005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:44.019868 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:44.019871 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:44.020170 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:44.020436 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:44.020437 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:44.020437 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:44.020578 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:44.020911 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:44.020917 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:44.021098 (+ 181us) client_negotiation.cc:769] Sending connection context
0809 03:25:44.021871 (+ 773us) client_negotiation.cc:240] Negotiation successful
0809 03:25:44.022045 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":96,"threads_started":1}
I20260809 03:25:44.023066 21680 heartbeater.cc:347] Connected to a master server at 127.8.5.254:35189
I20260809 03:25:44.023167 21680 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:44.023366 21680 heartbeater.cc:511] Master 127.8.5.254:35189 requested a full tablet report, sending...
I20260809 03:25:44.023787 21303 ts_manager.cc:194] Registered new tserver with Master: 951b1cce09414daa81906c2905ce9d5e (127.8.5.194:39047)
I20260809 03:25:44.024303 21303 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:52907
WARNING: no policy specified for kudu/127.8.5.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
I20260809 03:25:44.046887 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.5.212:57775/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:35189
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:40865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:25:44.177496 21685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:44.177850 21685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:44.177963 21685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:44.179816 21685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:44.179934 21685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:44.180032 21685 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:25:44.182591 21685 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:40865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.8.5.212:57775/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:35189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:44.182847 21685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:44.183271 21685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:44.196406 21694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:44.196916 21685 server_base.cc:1034] running on GCE node
W20260809 03:25:44.197070 21691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:44.197269 21692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:44.197547 21685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:44.197814 21685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:44.201148 21685 hybrid_clock.cc:648] HybridClock initialized: now 1786245944201107 us; error 51 us; skew 500 ppm
Aug 09 03:25:44 dist-test-slave-2w3w krb5kdc[20791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245944, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:44.204492 21685 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:25:44.205084 21685 webserver.cc:460] Webserver started at http://127.8.5.195:40773/ using document root <none> and password file <none>
I20260809 03:25:44.205384 21685 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:44.205482 21685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:44.205648 21685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 03:25:44 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245944, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
I20260809 03:25:44.219473 21685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "2dc9fb1dd2c741feb6511c2d94617bc9"
format_stamp: "Formatted at 2026-08-09 03:25:44 on dist-test-slave-2w3w"
server_key: "46bbdca440dfe85adc45c0227c4a323a"
server_key_iv: "f39b0fb148cf007e529cd4b758e8e781"
server_key_version: "kuduclusterkey@0"
I20260809 03:25:44.219877 21685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "2dc9fb1dd2c741feb6511c2d94617bc9"
format_stamp: "Formatted at 2026-08-09 03:25:44 on dist-test-slave-2w3w"
server_key: "46bbdca440dfe85adc45c0227c4a323a"
server_key_iv: "f39b0fb148cf007e529cd4b758e8e781"
server_key_version: "kuduclusterkey@0"
I20260809 03:25:44.221361 21685 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:25:44.235966 21703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:44.236254 21685 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 03:25:44.236435 21685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "2dc9fb1dd2c741feb6511c2d94617bc9"
format_stamp: "Formatted at 2026-08-09 03:25:44 on dist-test-slave-2w3w"
server_key: "46bbdca440dfe85adc45c0227c4a323a"
server_key_iv: "f39b0fb148cf007e529cd4b758e8e781"
server_key_version: "kuduclusterkey@0"
I20260809 03:25:44.236596 21685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:44.249876 21685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:44.252030 21685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:44.252202 21685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:44.252475 21685 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:25:44.252844 21685 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:25:44.252907 21685 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:44.252969 21685 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:25:44.252997 21685 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:44.260167 21685 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:35717
I20260809 03:25:44.260629 21685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:25:44.263042 21824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:35717 every 8 connection(s)
Aug 09 03:25:44 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245944, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:25:44.269368 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 21685
I20260809 03:25:44.269465 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:25:44.269665 8215 external_mini_cluster.cc:1428] Setting key 6c91f68e6af5c270f66fea0856601810
I20260809 03:25:44.273053 21536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:44.263134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:46991 (local address 127.8.5.254:35189)
0809 03:25:44.263186 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:44.263189 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:44.263512 (+ 323us) server_negotiation.cc:407] Connection header received
0809 03:25:44.264036 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:44.264037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:44.264048 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:44.264124 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:44.264669 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:44.265185 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:44.266161 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:44.266385 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:44.266462 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:44.268789 (+ 2327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:44.268791 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:44.268791 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:44.268799 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:44.271523 (+ 2724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:44.271944 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:44.271945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:44.271951 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:44.272013 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:44.272296 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:44.272297 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:44.272298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:44.272444 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:44.272516 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:44.272877 (+ 361us) server_negotiation.cc:299] Negotiation successful
0809 03:25:44.272962 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 03:25:44.273834 21827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:44.263122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:35189 (local address 127.8.5.195:46991)
0809 03:25:44.263371 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:44.263415 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:44.263927 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:44.264193 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:44.264196 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:44.264390 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:44.264571 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:44.264575 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:44.265283 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:44.265284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:44.266065 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:44.266067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:44.266485 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:44.266487 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:44.266608 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:44.267145 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:44.267153 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:44.268664 (+ 1511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:44.271632 (+ 2968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:44.271638 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:44.271640 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:44.271861 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:44.272105 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:44.272106 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:44.272106 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:44.272218 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:44.272521 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:44.272527 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:44.272710 (+ 183us) client_negotiation.cc:769] Sending connection context
0809 03:25:44.273420 (+ 710us) client_negotiation.cc:240] Negotiation successful
0809 03:25:44.273588 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":84,"threads_started":1}
I20260809 03:25:44.274467 21825 heartbeater.cc:347] Connected to a master server at 127.8.5.254:35189
I20260809 03:25:44.274554 21825 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:44.274753 21825 heartbeater.cc:511] Master 127.8.5.254:35189 requested a full tablet report, sending...
I20260809 03:25:44.275197 21303 ts_manager.cc:194] Registered new tserver with Master: 2dc9fb1dd2c741feb6511c2d94617bc9 (127.8.5.195:35717)
I20260809 03:25:44.275695 21303 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:46991
I20260809 03:25:44.281366 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:25:44.282145 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 21389
I20260809 03:25:44.291282 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 21542
I20260809 03:25:44.296442 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 21685
I20260809 03:25:44.302342 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 21267
I20260809 03:25:44.309919 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:35189
--webserver_interface=127.8.5.254
--webserver_port=38205
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:40865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:35189
--ranger_config_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.5.212:57775/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.5.212:57775/kms with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:25:44.390165 21828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:44.390362 21828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:44.390384 21828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:44.391436 21828 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:25:44.391471 21828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:44.391485 21828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:44.391496 21828 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:25:44.391508 21828 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:25:44.392982 21828 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:40865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.5.212:57775/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:35189
--ranger_config_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:35189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=38205
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:44.393146 21828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:44.393314 21828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:44.398129 21833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:44.398147 21828 server_base.cc:1034] running on GCE node
W20260809 03:25:44.398128 21836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:44.398124 21834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:44.398586 21828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:44.398890 21828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:44.400048 21828 hybrid_clock.cc:648] HybridClock initialized: now 1786245944400044 us; error 32 us; skew 500 ppm
Aug 09 03:25:44 dist-test-slave-2w3w krb5kdc[20791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245944, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:44.402422 21828 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:25:44.402787 21828 webserver.cc:460] Webserver started at http://127.8.5.254:38205/ using document root <none> and password file <none>
I20260809 03:25:44.403036 21828 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:44.403091 21828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 03:25:44 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245944, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
I20260809 03:25:44.441726 21828 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:25:44.442523 21845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:44.442723 21828 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:25:44.442876 21828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "d66c7923a50d4685986464c83d98f9cd"
format_stamp: "Formatted at 2026-08-09 03:25:42 on dist-test-slave-2w3w"
server_key: "417e50d7b104f0828edb71662749fa4e"
server_key_iv: "b98cf0c638e119c71c73816d03ec016e"
server_key_version: "kuduclusterkey@0"
I20260809 03:25:44.443300 21828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:44.464298 21828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:44.465827 21828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:44.465994 21828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:44.470006 21828 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:35189
I20260809 03:25:44.470041 21904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:35189 every 8 connection(s)
I20260809 03:25:44.470389 21828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:25:44.471634 21905 sys_catalog.cc:263] Verifying existing consensus state
I20260809 03:25:44.472193 21905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd: Bootstrap starting.
I20260809 03:25:44.475535 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 21828
I20260809 03:25:44.475797 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.5.212:57775/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:38751
--local_ip_for_outbound_sockets=127.8.5.193
--tserver_master_addrs=127.8.5.254:35189
--webserver_port=33965
--webserver_interface=127.8.5.193
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:40865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.5.212:57775/kms with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 03:25:44.480173 21905 log.cc:824] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:44.481763 21905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 03:25:44.482065 21905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd: Bootstrap complete.
I20260809 03:25:44.484519 21905 raft_consensus.cc:348] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d66c7923a50d4685986464c83d98f9cd" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35189 } }
I20260809 03:25:44.484769 21905 raft_consensus.cc:729] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d66c7923a50d4685986464c83d98f9cd, State: Initialized, Role: FOLLOWER
I20260809 03:25:44.484949 21905 consensus_queue.cc:260] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d66c7923a50d4685986464c83d98f9cd" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35189 } }
I20260809 03:25:44.485028 21905 raft_consensus.cc:388] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:25:44.485085 21905 raft_consensus.cc:482] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:25:44.485131 21905 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [term 1 FOLLOWER]: Advancing to term 2
I20260809 03:25:44.486095 21905 raft_consensus.cc:504] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d66c7923a50d4685986464c83d98f9cd" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35189 } }
I20260809 03:25:44.486217 21905 leader_election.cc:302] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d66c7923a50d4685986464c83d98f9cd; no voters:
I20260809 03:25:44.486409 21905 leader_election.cc:288] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 03:25:44.486469 21909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [term 2 FOLLOWER]: Leader election won for term 2
I20260809 03:25:44.486640 21909 raft_consensus.cc:686] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [term 2 LEADER]: Becoming Leader. State: Replica: d66c7923a50d4685986464c83d98f9cd, State: Running, Role: LEADER
I20260809 03:25:44.486660 21905 sys_catalog.cc:564] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:25:44.486821 21909 consensus_queue.cc:237] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d66c7923a50d4685986464c83d98f9cd" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35189 } }
I20260809 03:25:44.487102 21910 sys_catalog.cc:455] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d66c7923a50d4685986464c83d98f9cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d66c7923a50d4685986464c83d98f9cd" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35189 } } }
I20260809 03:25:44.487099 21911 sys_catalog.cc:455] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader d66c7923a50d4685986464c83d98f9cd. Latest consensus state: current_term: 2 leader_uuid: "d66c7923a50d4685986464c83d98f9cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d66c7923a50d4685986464c83d98f9cd" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35189 } } }
I20260809 03:25:44.487322 21910 sys_catalog.cc:458] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [sys.catalog]: This master's current role is: LEADER
I20260809 03:25:44.487336 21911 sys_catalog.cc:458] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd [sys.catalog]: This master's current role is: LEADER
I20260809 03:25:44.487574 21917 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:25:44.488071 21917 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:25:44.488237 21917 catalog_manager.cc:1259] Loaded cluster ID: a05e4ea8159f42c9ba3f3f852140eec5
I20260809 03:25:44.488308 21917 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:25:44.488426 21905 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 03:25:44.489681 21917 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:25:44.489848 21917 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd: Loaded TSK: 0
I20260809 03:25:44.490051 21917 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 03:25:44.582129 21907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:44.582460 21907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:44.582522 21907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:44.583920 21907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:44.583993 21907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:44.584039 21907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:25:44.585515 21907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:40865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.5.212:57775/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:38751
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=33965
--tserver_master_addrs=127.8.5.254:35189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:44.585778 21907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:44.586062 21907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:44.591439 21946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:44.591547 21943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:44.591460 21944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:44.592144 21907 server_base.cc:1034] running on GCE node
I20260809 03:25:44.592358 21907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:44.592602 21907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:44.608162 21907 hybrid_clock.cc:648] HybridClock initialized: now 1786245944604797 us; error 3372 us; skew 500 ppm
Aug 09 03:25:44 dist-test-slave-2w3w krb5kdc[20791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245944, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:44.611598 21907 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:25:44.612185 21907 webserver.cc:460] Webserver started at http://127.8.5.193:33965/ using document root <none> and password file <none>
I20260809 03:25:44.612458 21907 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:44.612547 21907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 03:25:44 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245944, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
I20260809 03:25:44.630415 21907 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260809 03:25:44.632277 21954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:44.632445 21907 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260809 03:25:44.632531 21907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "3c82bfbb6b03487786fbd7f90f36d21b"
format_stamp: "Formatted at 2026-08-09 03:25:43 on dist-test-slave-2w3w"
server_key: "16b5a89091ccbf80ca7124a65827f818"
server_key_iv: "743136eec58e681b0686aaa91660a34a"
server_key_version: "kuduclusterkey@0"
I20260809 03:25:44.632992 21907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:44.645956 21907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:44.648362 21907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:44.648521 21907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:44.648765 21907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:25:44.649133 21907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:25:44.649183 21907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:44.649212 21907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:25:44.649230 21907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:44.656700 21907 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:38751
I20260809 03:25:44.657186 21907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:25:44.657696 22078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:38751 every 8 connection(s)
I20260809 03:25:44.661895 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 21907
I20260809 03:25:44.662173 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.5.212:57775/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:39047
--local_ip_for_outbound_sockets=127.8.5.194
--tserver_master_addrs=127.8.5.254:35189
--webserver_port=40067
--webserver_interface=127.8.5.194
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:40865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.5.212:57775/kms with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 03:25:44 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245944, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:25:44.670329 22083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:44.658306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:53087 (local address 127.8.5.254:35189)
0809 03:25:44.658515 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:44.658524 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:44.658561 (+ 37us) server_negotiation.cc:407] Connection header received
0809 03:25:44.659266 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:44.659272 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:44.659330 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:44.659473 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:44.660156 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:44.661332 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:44.662776 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:44.663447 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:44.663557 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:44.665971 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:44.665975 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:44.665975 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:44.665987 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:44.668181 (+ 2194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:44.668690 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:44.668694 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:44.668694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:44.668816 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:44.669120 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:44.669121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:44.669121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:44.669466 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:44.669560 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:44.669922 (+ 362us) server_negotiation.cc:299] Negotiation successful
0809 03:25:44.670068 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":81,"threads_started":1}
I20260809 03:25:44.670437 22082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:44.657917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:35189 (local address 127.8.5.193:53087)
0809 03:25:44.658279 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:44.658320 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:44.658950 (+ 630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:44.659543 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:44.659547 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:44.659767 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:44.660038 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:44.660044 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:44.661452 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:44.661453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:44.662682 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:44.662685 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:44.663565 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:44.663567 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:44.663701 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:44.664191 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:44.664200 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:44.665851 (+ 1651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:44.668278 (+ 2427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:44.668284 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:44.668286 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:44.668586 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:44.668900 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:44.668901 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:44.668901 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:44.669038 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:44.669557 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:44.669566 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:44.669719 (+ 153us) client_negotiation.cc:769] Sending connection context
0809 03:25:44.669855 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 03:25:44.670016 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":80,"threads_started":1}
I20260809 03:25:44.671620 22080 heartbeater.cc:347] Connected to a master server at 127.8.5.254:35189
I20260809 03:25:44.671718 22080 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:44.671914 22080 heartbeater.cc:511] Master 127.8.5.254:35189 requested a full tablet report, sending...
W20260809 03:25:44.672942 22080 heartbeater.cc:644] Failed to heartbeat to 127.8.5.254:35189 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 03:25:44.673019 22080 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:44.673091 22080 heartbeater.cc:511] Master 127.8.5.254:35189 requested a full tablet report, sending...
I20260809 03:25:44.673610 22080 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:44.673689 22080 heartbeater.cc:511] Master 127.8.5.254:35189 requested a full tablet report, sending...
W20260809 03:25:44.674130 22080 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 03:25:44.770882 22084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:44.771235 22084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:44.771279 22084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:44.772714 22084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:44.772773 22084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:44.772814 22084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:25:44.774940 22084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:40865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.5.212:57775/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:39047
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=40067
--tserver_master_addrs=127.8.5.254:35189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22084
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:44.775214 22084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:44.775516 22084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:44.783691 22091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:44.784214 22093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:44.784214 22084 server_base.cc:1034] running on GCE node
W20260809 03:25:44.785780 22090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:44.786051 22084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:44.786335 22084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:44.787494 22084 hybrid_clock.cc:648] HybridClock initialized: now 1786245944787475 us; error 35 us; skew 500 ppm
Aug 09 03:25:44 dist-test-slave-2w3w krb5kdc[20791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245944, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:44.790748 22084 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:25:44.791276 22084 webserver.cc:460] Webserver started at http://127.8.5.194:40067/ using document root <none> and password file <none>
I20260809 03:25:44.791555 22084 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:44.791666 22084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 03:25:44 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245944, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
I20260809 03:25:44.811411 22084 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.001s sys 0.000s
I20260809 03:25:44.815502 22102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:44.815768 22084 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.000s
I20260809 03:25:44.815892 22084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "951b1cce09414daa81906c2905ce9d5e"
format_stamp: "Formatted at 2026-08-09 03:25:43 on dist-test-slave-2w3w"
server_key: "1275a35ff2e0d26330509113bcb10254"
server_key_iv: "d2680c05679e6954fe069ad4cc385057"
server_key_version: "kuduclusterkey@0"
I20260809 03:25:44.816406 22084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:44.867048 22084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:44.869791 22084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:44.870018 22084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:44.870328 22084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:25:44.870764 22084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:25:44.870836 22084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:44.870872 22084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:25:44.870893 22084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:44.879195 22084 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:39047
I20260809 03:25:44.879268 22228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:39047 every 8 connection(s)
I20260809 03:25:44.879771 22084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:25:44.883260 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 22084
I20260809 03:25:44.883620 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.5.212:57775/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:35717
--local_ip_for_outbound_sockets=127.8.5.195
--tserver_master_addrs=127.8.5.254:35189
--webserver_port=40773
--webserver_interface=127.8.5.195
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:40865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.5.212:57775/kms with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 03:25:44 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245944, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:25:44.891222 22083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:44.880589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:47097 (local address 127.8.5.254:35189)
0809 03:25:44.880669 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:44.880672 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:44.880827 (+ 155us) server_negotiation.cc:407] Connection header received
0809 03:25:44.881317 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:44.881319 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:44.881337 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:44.881425 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:44.881952 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:44.882824 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:44.884392 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:44.884739 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:44.884845 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:44.887655 (+ 2810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:44.887656 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:44.887657 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:44.887666 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:44.889513 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:44.890044 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:44.890046 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:44.890046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:44.890110 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:44.890404 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:44.890405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:44.890405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:44.890543 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:44.890591 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:44.891027 (+ 436us) server_negotiation.cc:299] Negotiation successful
0809 03:25:44.891117 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 03:25:44.891765 22231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:44.880510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:35189 (local address 127.8.5.194:47097)
0809 03:25:44.880689 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:44.880732 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:44.881205 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:44.881492 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:44.881495 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:44.881655 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:44.881836 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:44.881853 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:44.882947 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:44.882948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:44.884287 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:44.884290 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:44.884883 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:44.884885 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:44.885031 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:44.885653 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:44.885671 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:44.887520 (+ 1849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:44.889617 (+ 2097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:44.889623 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:44.889626 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:44.889942 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:44.890188 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:44.890188 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:44.890189 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:44.890322 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:44.890644 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:44.890651 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:44.890820 (+ 169us) client_negotiation.cc:769] Sending connection context
0809 03:25:44.891362 (+ 542us) client_negotiation.cc:240] Negotiation successful
0809 03:25:44.891527 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":88,"threads_started":1}
I20260809 03:25:44.892446 22229 heartbeater.cc:347] Connected to a master server at 127.8.5.254:35189
I20260809 03:25:44.892539 22229 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:44.892714 22229 heartbeater.cc:511] Master 127.8.5.254:35189 requested a full tablet report, sending...
W20260809 03:25:44.893399 22229 heartbeater.cc:644] Failed to heartbeat to 127.8.5.254:35189 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 03:25:44.893471 22229 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:44.893530 22229 heartbeater.cc:511] Master 127.8.5.254:35189 requested a full tablet report, sending...
I20260809 03:25:44.893970 22229 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:44.894048 22229 heartbeater.cc:511] Master 127.8.5.254:35189 requested a full tablet report, sending...
W20260809 03:25:44.894477 22229 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 03:25:44.994720 22232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:44.995178 22232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:44.995293 22232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:44.997205 22232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:44.997340 22232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:44.997440 22232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:25:44.999918 22232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:40865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.5.212:57775/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:35717
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=40773
--tserver_master_addrs=127.8.5.254:35189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:45.000438 22232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:45.000846 22232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:45.007990 22239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:45.008003 22241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:45.009053 22232 server_base.cc:1034] running on GCE node
W20260809 03:25:45.009610 22238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:45.009904 22232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:45.010215 22232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:45.011377 22232 hybrid_clock.cc:648] HybridClock initialized: now 1786245945011369 us; error 50 us; skew 500 ppm
Aug 09 03:25:45 dist-test-slave-2w3w krb5kdc[20791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245945, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:45.014117 22232 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:25:45.014704 22232 webserver.cc:460] Webserver started at http://127.8.5.195:40773/ using document root <none> and password file <none>
I20260809 03:25:45.015036 22232 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:45.015129 22232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 03:25:45 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245945, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
I20260809 03:25:45.031322 22232 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:25:45.034540 22250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:45.034780 22232 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 03:25:45.034869 22232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "2dc9fb1dd2c741feb6511c2d94617bc9"
format_stamp: "Formatted at 2026-08-09 03:25:44 on dist-test-slave-2w3w"
server_key: "46bbdca440dfe85adc45c0227c4a323a"
server_key_iv: "f39b0fb148cf007e529cd4b758e8e781"
server_key_version: "kuduclusterkey@0"
I20260809 03:25:45.035377 22232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:45.047959 22232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:45.050484 22232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:45.050632 22232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:45.050882 22232 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:25:45.051252 22232 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:25:45.051295 22232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:45.051347 22232 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:25:45.051371 22232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:45.059967 22232 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:35717
I20260809 03:25:45.060479 22232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:25:45.061652 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 22232
I20260809 03:25:45.063155 22373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:35717 every 8 connection(s)
Aug 09 03:25:45 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245945, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:25:45.071779 22083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:45.062088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45348 (local address 127.8.5.254:35189)
0809 03:25:45.062144 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:45.062146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:45.063799 (+ 1653us) server_negotiation.cc:407] Connection header received
0809 03:25:45.063894 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:45.063895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:45.063907 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:45.063961 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:45.064759 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:45.065260 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:45.066350 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:45.066556 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:45.066649 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:45.068156 (+ 1507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:45.068157 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:45.068157 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:45.068165 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:45.069807 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:45.070642 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:45.070643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:45.070643 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:45.070692 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:45.070899 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:45.070900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:45.070900 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:45.071069 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:45.071258 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:45.071583 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 03:25:45.071660 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 03:25:45.074198 22378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:45.064097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:57489 (local address 127.8.5.254:35189)
0809 03:25:45.065049 (+ 952us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:45.065051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:45.065058 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:25:45.065080 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:45.065081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:45.065092 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:45.065151 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:45.065863 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:45.066659 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:45.068165 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:45.068483 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:45.068546 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:45.070989 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:45.070990 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:45.070990 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:45.070998 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:45.072773 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:45.073242 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:45.073243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:45.073243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:45.073296 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:45.073569 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:45.073570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:45.073570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:45.073663 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:45.073712 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:45.074045 (+ 333us) server_negotiation.cc:299] Negotiation successful
0809 03:25:45.074129 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":925,"thread_start_us":58,"threads_started":1}
I20260809 03:25:45.074409 22377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:45.063830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:35189 (local address 127.8.5.195:57489)
0809 03:25:45.064226 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:45.064270 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:45.064873 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:45.065267 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:45.065271 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:45.065492 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:45.065754 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:45.065759 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:45.066767 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:45.066767 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:45.068065 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:45.068069 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:45.068643 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:45.068645 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:45.068780 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:45.069484 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:45.069494 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:45.070870 (+ 1376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:45.072850 (+ 1980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:45.072856 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:45.072858 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:45.073167 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:45.073360 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:45.073360 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:45.073361 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:45.073498 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:45.073734 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:45.073741 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:45.073900 (+ 159us) client_negotiation.cc:769] Sending connection context
0809 03:25:45.073994 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 03:25:45.074160 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":82,"threads_started":1}
I20260809 03:25:45.075004 22374 heartbeater.cc:347] Connected to a master server at 127.8.5.254:35189
I20260809 03:25:45.075112 22374 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:45.075311 22374 heartbeater.cc:511] Master 127.8.5.254:35189 requested a full tablet report, sending...
W20260809 03:25:45.075961 22374 heartbeater.cc:644] Failed to heartbeat to 127.8.5.254:35189 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 03:25:45.076035 22374 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:45.076093 22374 heartbeater.cc:511] Master 127.8.5.254:35189 requested a full tablet report, sending...
I20260809 03:25:45.076392 22374 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:45.076465 22374 heartbeater.cc:511] Master 127.8.5.254:35189 requested a full tablet report, sending...
W20260809 03:25:45.076725 22374 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 03:25:45 dist-test-slave-2w3w krb5kdc[20791](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786245945, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:45.674333 22080 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:45.674491 22080 heartbeater.cc:511] Master 127.8.5.254:35189 requested a full tablet report, sending...
I20260809 03:25:45.674935 21866 ts_manager.cc:194] Registered new tserver with Master: 3c82bfbb6b03487786fbd7f90f36d21b (127.8.5.193:38751)
I20260809 03:25:45.675976 21866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:53087
I20260809 03:25:45.894680 22229 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:45.894887 22229 heartbeater.cc:511] Master 127.8.5.254:35189 requested a full tablet report, sending...
I20260809 03:25:45.895309 21866 ts_manager.cc:194] Registered new tserver with Master: 951b1cce09414daa81906c2905ce9d5e (127.8.5.194:39047)
I20260809 03:25:45.895718 21866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:47097
Aug 09 03:25:45 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245945, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
I20260809 03:25:46.076920 22374 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:46.077075 22374 heartbeater.cc:511] Master 127.8.5.254:35189 requested a full tablet report, sending...
I20260809 03:25:46.077415 21866 ts_manager.cc:194] Registered new tserver with Master: 2dc9fb1dd2c741feb6511c2d94617bc9 (127.8.5.195:35717)
I20260809 03:25:46.077932 21866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:57489
I20260809 03:25:46.078083 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:25:46.091794 22398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:46.079090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45364 (local address 127.8.5.254:35189)
0809 03:25:46.079239 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:46.079242 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:46.079445 (+ 203us) server_negotiation.cc:407] Connection header received
0809 03:25:46.079497 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:46.079498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:46.079511 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:46.079581 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:46.080289 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.081055 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.082109 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.082425 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.082493 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:46.089014 (+ 6521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:46.089016 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:46.089016 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:46.089024 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:46.090564 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:46.090935 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:46.090954 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:46.090955 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:46.091046 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:46.091254 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:46.091255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:46.091255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:46.091382 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:46.091486 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:46.091592 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 03:25:46.091679 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":80,"threads_started":1}
I20260809 03:25:46.096994 21866 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45364:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:25:46.098687 21866 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:25:46.106038 22407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:46.101512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:35717 (local address 127.0.0.1:36398)
0809 03:25:46.102671 (+ 1159us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:46.102701 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:46.102790 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:46.102993 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:46.102996 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:46.102999 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:25:46.103078 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:46.103079 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.103943 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.103944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:46.105015 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:46.105018 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.105732 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.105733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:46.105823 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:46.105838 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 03:25:46.105910 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 03:25:46.105962 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1137,"thread_start_us":89,"threads_started":1}
I20260809 03:25:46.106046 22408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:46.101771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36398 (local address 127.8.5.195:35717)
0809 03:25:46.102616 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:46.102619 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:46.102772 (+ 153us) server_negotiation.cc:407] Connection header received
0809 03:25:46.102868 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:46.102871 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:46.102886 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:46.102978 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:25:46.103170 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.103855 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.105106 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.105643 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.105732 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:46.105794 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:46.105930 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 03:25:46.105975 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":820,"thread_start_us":63,"threads_started":1}
I20260809 03:25:46.107162 22292 tablet_service.cc:1467] Processing CreateTablet for tablet 87decbedbce346d19f437f4a7f314ae7 (DEFAULT_TABLE table=test-table [id=ccc0bec5dd324b49bee16be7633486d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:25:46.107568 22292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87decbedbce346d19f437f4a7f314ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:25:46.111214 22405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:46.101738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:39047 (local address 127.0.0.1:42602)
0809 03:25:46.107083 (+ 5345us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:46.107095 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:46.107151 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:46.107450 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:46.107451 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:46.107453 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:25:46.107493 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:46.107494 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.108675 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.108676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:46.109909 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:46.109912 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.110934 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.110935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:46.111028 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:46.111033 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 03:25:46.111084 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 03:25:46.111121 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5328,"thread_start_us":93,"threads_started":1}
I20260809 03:25:46.111521 22409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:46.101930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42602 (local address 127.8.5.194:39047)
0809 03:25:46.102041 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:46.102047 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:46.107219 (+ 5172us) server_negotiation.cc:407] Connection header received
0809 03:25:46.107260 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:46.107262 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:46.107278 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:46.107350 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:25:46.107573 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.108576 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.110009 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.110753 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.110838 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:46.110896 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:46.111402 (+ 506us) server_negotiation.cc:299] Negotiation successful
0809 03:25:46.111444 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":58,"threads_started":1}
I20260809 03:25:46.112201 22155 tablet_service.cc:1467] Processing CreateTablet for tablet 87decbedbce346d19f437f4a7f314ae7 (DEFAULT_TABLE table=test-table [id=ccc0bec5dd324b49bee16be7633486d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:25:46.112555 22155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87decbedbce346d19f437f4a7f314ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:25:46.116410 22407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:46.101512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:38751 (local address 127.0.0.1:43332)
0809 03:25:46.106434 (+ 4922us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:46.106445 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:46.112082 (+ 5637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:46.112444 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:46.112445 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:46.112447 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:25:46.112477 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:46.112478 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.113735 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.113735 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:46.115092 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:46.115095 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.116182 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.116182 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:46.116224 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:46.116226 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:25:46.116295 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 03:25:46.116340 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4909,"mutex_wait_us":2,"thread_start_us":81,"threads_started":1}
I20260809 03:25:46.116418 22410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:46.102073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43332 (local address 127.8.5.193:38751)
0809 03:25:46.102544 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:46.102548 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:46.112043 (+ 9495us) server_negotiation.cc:407] Connection header received
0809 03:25:46.112186 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:46.112189 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:46.112206 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:46.112259 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:25:46.112566 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.113628 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.115193 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.116059 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.116102 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:46.116138 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:46.116309 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 03:25:46.116348 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":50,"threads_started":1}
I20260809 03:25:46.117228 21984 tablet_service.cc:1467] Processing CreateTablet for tablet 87decbedbce346d19f437f4a7f314ae7 (DEFAULT_TABLE table=test-table [id=ccc0bec5dd324b49bee16be7633486d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:25:46.117518 21984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87decbedbce346d19f437f4a7f314ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:25:46.119122 22414 tablet_bootstrap.cc:492] T 87decbedbce346d19f437f4a7f314ae7 P 951b1cce09414daa81906c2905ce9d5e: Bootstrap starting.
I20260809 03:25:46.119827 22414 tablet_bootstrap.cc:654] T 87decbedbce346d19f437f4a7f314ae7 P 951b1cce09414daa81906c2905ce9d5e: Neither blocks nor log segments found. Creating new log.
I20260809 03:25:46.120236 22414 log.cc:824] T 87decbedbce346d19f437f4a7f314ae7 P 951b1cce09414daa81906c2905ce9d5e: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:46.123111 22415 tablet_bootstrap.cc:492] T 87decbedbce346d19f437f4a7f314ae7 P 3c82bfbb6b03487786fbd7f90f36d21b: Bootstrap starting.
I20260809 03:25:46.123102 22413 tablet_bootstrap.cc:492] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9: Bootstrap starting.
I20260809 03:25:46.123771 22413 tablet_bootstrap.cc:654] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9: Neither blocks nor log segments found. Creating new log.
I20260809 03:25:46.124069 22413 log.cc:824] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:46.124156 22415 tablet_bootstrap.cc:654] T 87decbedbce346d19f437f4a7f314ae7 P 3c82bfbb6b03487786fbd7f90f36d21b: Neither blocks nor log segments found. Creating new log.
I20260809 03:25:46.124511 22415 log.cc:824] T 87decbedbce346d19f437f4a7f314ae7 P 3c82bfbb6b03487786fbd7f90f36d21b: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:46.124606 22414 tablet_bootstrap.cc:492] T 87decbedbce346d19f437f4a7f314ae7 P 951b1cce09414daa81906c2905ce9d5e: No bootstrap required, opened a new log
I20260809 03:25:46.124668 22414 ts_tablet_manager.cc:1397] T 87decbedbce346d19f437f4a7f314ae7 P 951b1cce09414daa81906c2905ce9d5e: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260809 03:25:46.124788 22413 tablet_bootstrap.cc:492] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9: No bootstrap required, opened a new log
I20260809 03:25:46.124845 22413 ts_tablet_manager.cc:1397] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:25:46.126423 22414 raft_consensus.cc:348] T 87decbedbce346d19f437f4a7f314ae7 P 951b1cce09414daa81906c2905ce9d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c82bfbb6b03487786fbd7f90f36d21b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 38751 } } peers { permanent_uuid: "951b1cce09414daa81906c2905ce9d5e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39047 } } peers { permanent_uuid: "2dc9fb1dd2c741feb6511c2d94617bc9" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35717 } }
I20260809 03:25:46.126538 22414 raft_consensus.cc:374] T 87decbedbce346d19f437f4a7f314ae7 P 951b1cce09414daa81906c2905ce9d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:25:46.126557 22414 raft_consensus.cc:729] T 87decbedbce346d19f437f4a7f314ae7 P 951b1cce09414daa81906c2905ce9d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951b1cce09414daa81906c2905ce9d5e, State: Initialized, Role: FOLLOWER
I20260809 03:25:46.126672 22414 consensus_queue.cc:260] T 87decbedbce346d19f437f4a7f314ae7 P 951b1cce09414daa81906c2905ce9d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c82bfbb6b03487786fbd7f90f36d21b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 38751 } } peers { permanent_uuid: "951b1cce09414daa81906c2905ce9d5e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39047 } } peers { permanent_uuid: "2dc9fb1dd2c741feb6511c2d94617bc9" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35717 } }
I20260809 03:25:46.126930 22414 ts_tablet_manager.cc:1428] T 87decbedbce346d19f437f4a7f314ae7 P 951b1cce09414daa81906c2905ce9d5e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 03:25:46.127012 22229 heartbeater.cc:503] Master 127.8.5.254:35189 was elected leader, sending a full tablet report...
I20260809 03:25:46.127265 22413 raft_consensus.cc:348] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c82bfbb6b03487786fbd7f90f36d21b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 38751 } } peers { permanent_uuid: "951b1cce09414daa81906c2905ce9d5e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39047 } } peers { permanent_uuid: "2dc9fb1dd2c741feb6511c2d94617bc9" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35717 } }
I20260809 03:25:46.127429 22413 raft_consensus.cc:374] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:25:46.127462 22413 raft_consensus.cc:729] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc9fb1dd2c741feb6511c2d94617bc9, State: Initialized, Role: FOLLOWER
I20260809 03:25:46.127585 22413 consensus_queue.cc:260] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c82bfbb6b03487786fbd7f90f36d21b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 38751 } } peers { permanent_uuid: "951b1cce09414daa81906c2905ce9d5e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39047 } } peers { permanent_uuid: "2dc9fb1dd2c741feb6511c2d94617bc9" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35717 } }
I20260809 03:25:46.127812 22413 ts_tablet_manager.cc:1428] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 03:25:46.127919 22374 heartbeater.cc:503] Master 127.8.5.254:35189 was elected leader, sending a full tablet report...
I20260809 03:25:46.128907 22415 tablet_bootstrap.cc:492] T 87decbedbce346d19f437f4a7f314ae7 P 3c82bfbb6b03487786fbd7f90f36d21b: No bootstrap required, opened a new log
I20260809 03:25:46.128978 22415 ts_tablet_manager.cc:1397] T 87decbedbce346d19f437f4a7f314ae7 P 3c82bfbb6b03487786fbd7f90f36d21b: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
W20260809 03:25:46.130980 22230 tablet.cc:2369] T 87decbedbce346d19f437f4a7f314ae7 P 951b1cce09414daa81906c2905ce9d5e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:25:46.131011 22415 raft_consensus.cc:348] T 87decbedbce346d19f437f4a7f314ae7 P 3c82bfbb6b03487786fbd7f90f36d21b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c82bfbb6b03487786fbd7f90f36d21b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 38751 } } peers { permanent_uuid: "951b1cce09414daa81906c2905ce9d5e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39047 } } peers { permanent_uuid: "2dc9fb1dd2c741feb6511c2d94617bc9" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35717 } }
I20260809 03:25:46.131145 22415 raft_consensus.cc:374] T 87decbedbce346d19f437f4a7f314ae7 P 3c82bfbb6b03487786fbd7f90f36d21b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:25:46.131182 22415 raft_consensus.cc:729] T 87decbedbce346d19f437f4a7f314ae7 P 3c82bfbb6b03487786fbd7f90f36d21b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82bfbb6b03487786fbd7f90f36d21b, State: Initialized, Role: FOLLOWER
I20260809 03:25:46.131284 22415 consensus_queue.cc:260] T 87decbedbce346d19f437f4a7f314ae7 P 3c82bfbb6b03487786fbd7f90f36d21b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c82bfbb6b03487786fbd7f90f36d21b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 38751 } } peers { permanent_uuid: "951b1cce09414daa81906c2905ce9d5e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39047 } } peers { permanent_uuid: "2dc9fb1dd2c741feb6511c2d94617bc9" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35717 } }
I20260809 03:25:46.131505 22415 ts_tablet_manager.cc:1428] T 87decbedbce346d19f437f4a7f314ae7 P 3c82bfbb6b03487786fbd7f90f36d21b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 03:25:46.131676 22080 heartbeater.cc:503] Master 127.8.5.254:35189 was elected leader, sending a full tablet report...
W20260809 03:25:46.159026 22081 tablet.cc:2369] T 87decbedbce346d19f437f4a7f314ae7 P 3c82bfbb6b03487786fbd7f90f36d21b: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 03:25:46 dist-test-slave-2w3w krb5kdc[20791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245945, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for HTTP/127.8.5.212@KRBTEST.COM
W20260809 03:25:46.314451 22375 tablet.cc:2369] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:25:46.340325 22420 raft_consensus.cc:482] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:25:46.340476 22420 raft_consensus.cc:504] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c82bfbb6b03487786fbd7f90f36d21b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 38751 } } peers { permanent_uuid: "951b1cce09414daa81906c2905ce9d5e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39047 } } peers { permanent_uuid: "2dc9fb1dd2c741feb6511c2d94617bc9" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35717 } }
I20260809 03:25:46.340847 22420 leader_election.cc:288] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c82bfbb6b03487786fbd7f90f36d21b (127.8.5.193:38751), 951b1cce09414daa81906c2905ce9d5e (127.8.5.194:39047)
I20260809 03:25:46.349372 22410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:46.341626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:57627 (local address 127.8.5.193:38751)
0809 03:25:46.341735 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:46.341737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:46.345638 (+ 3901us) server_negotiation.cc:407] Connection header received
0809 03:25:46.345713 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:46.345714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:46.345730 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:46.345782 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:25:46.346026 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.346826 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.348378 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.348927 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.348979 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:46.348992 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:46.349240 (+ 248us) server_negotiation.cc:299] Negotiation successful
0809 03:25:46.349284 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 03:25:46.349663 22424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:46.341107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:38751 (local address 127.8.5.195:57627)
0809 03:25:46.345548 (+ 4441us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:46.345559 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:46.345651 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:46.345839 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:46.345840 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:46.345842 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:25:46.345933 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:46.345935 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.346998 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.346999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:46.348253 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:46.348256 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.349079 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.349080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:46.349151 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:46.349156 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 03:25:46.349517 (+ 361us) client_negotiation.cc:240] Negotiation successful
0809 03:25:46.349561 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4412,"thread_start_us":105,"threads_started":1}
I20260809 03:25:46.350023 22028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87decbedbce346d19f437f4a7f314ae7" candidate_uuid: "2dc9fb1dd2c741feb6511c2d94617bc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82bfbb6b03487786fbd7f90f36d21b" is_pre_election: true
I20260809 03:25:46.350200 22028 raft_consensus.cc:2454] T 87decbedbce346d19f437f4a7f314ae7 P 3c82bfbb6b03487786fbd7f90f36d21b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dc9fb1dd2c741feb6511c2d94617bc9 in term 0.
I20260809 03:25:46.350459 22251 leader_election.cc:302] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc9fb1dd2c741feb6511c2d94617bc9, 3c82bfbb6b03487786fbd7f90f36d21b; no voters:
I20260809 03:25:46.350610 22420 raft_consensus.cc:2781] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:25:46.350659 22420 raft_consensus.cc:482] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:25:46.350682 22420 raft_consensus.cc:3037] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:25:46.351671 22420 raft_consensus.cc:504] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c82bfbb6b03487786fbd7f90f36d21b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 38751 } } peers { permanent_uuid: "951b1cce09414daa81906c2905ce9d5e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39047 } } peers { permanent_uuid: "2dc9fb1dd2c741feb6511c2d94617bc9" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35717 } }
I20260809 03:25:46.351830 22420 leader_election.cc:288] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [CANDIDATE]: Term 1 election: Requested vote from peers 3c82bfbb6b03487786fbd7f90f36d21b (127.8.5.193:38751), 951b1cce09414daa81906c2905ce9d5e (127.8.5.194:39047)
I20260809 03:25:46.352036 22028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87decbedbce346d19f437f4a7f314ae7" candidate_uuid: "2dc9fb1dd2c741feb6511c2d94617bc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82bfbb6b03487786fbd7f90f36d21b"
I20260809 03:25:46.352123 22028 raft_consensus.cc:3037] T 87decbedbce346d19f437f4a7f314ae7 P 3c82bfbb6b03487786fbd7f90f36d21b [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:25:46.353016 22028 raft_consensus.cc:2454] T 87decbedbce346d19f437f4a7f314ae7 P 3c82bfbb6b03487786fbd7f90f36d21b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc9fb1dd2c741feb6511c2d94617bc9 in term 1.
I20260809 03:25:46.353189 22251 leader_election.cc:302] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc9fb1dd2c741feb6511c2d94617bc9, 3c82bfbb6b03487786fbd7f90f36d21b; no voters:
I20260809 03:25:46.353267 22420 raft_consensus.cc:2781] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:25:46.353407 22420 raft_consensus.cc:686] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [term 1 LEADER]: Becoming Leader. State: Replica: 2dc9fb1dd2c741feb6511c2d94617bc9, State: Running, Role: LEADER
I20260809 03:25:46.353526 22420 consensus_queue.cc:237] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c82bfbb6b03487786fbd7f90f36d21b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 38751 } } peers { permanent_uuid: "951b1cce09414daa81906c2905ce9d5e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39047 } } peers { permanent_uuid: "2dc9fb1dd2c741feb6511c2d94617bc9" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35717 } }
I20260809 03:25:46.353967 22409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:46.341690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:57429 (local address 127.8.5.194:39047)
0809 03:25:46.341767 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:46.341769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:46.349991 (+ 8222us) server_negotiation.cc:407] Connection header received
0809 03:25:46.350109 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:46.350111 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:46.350127 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:46.350161 (+ 34us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:25:46.350615 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.351323 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.352911 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.353476 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.353536 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:46.353545 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:46.353856 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 03:25:46.353901 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 03:25:46.354348 22425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:46.341320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:39047 (local address 127.8.5.195:57429)
0809 03:25:46.349904 (+ 8584us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:46.349918 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:46.350025 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:46.350406 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:46.350407 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:46.350409 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:25:46.350467 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:46.350469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.351504 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.351505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:46.352807 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:46.352809 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.353699 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.353700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:46.353774 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:46.353777 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:25:46.354216 (+ 439us) client_negotiation.cc:240] Negotiation successful
0809 03:25:46.354258 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8560,"thread_start_us":70,"threads_started":1}
I20260809 03:25:46.354393 21866 catalog_manager.cc:5495] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2dc9fb1dd2c741feb6511c2d94617bc9 (127.8.5.195). New cstate: current_term: 1 leader_uuid: "2dc9fb1dd2c741feb6511c2d94617bc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c82bfbb6b03487786fbd7f90f36d21b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 38751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "951b1cce09414daa81906c2905ce9d5e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2dc9fb1dd2c741feb6511c2d94617bc9" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35717 } health_report { overall_health: HEALTHY } } }
I20260809 03:25:46.354830 22179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87decbedbce346d19f437f4a7f314ae7" candidate_uuid: "2dc9fb1dd2c741feb6511c2d94617bc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951b1cce09414daa81906c2905ce9d5e" is_pre_election: true
I20260809 03:25:46.354979 22179 raft_consensus.cc:2454] T 87decbedbce346d19f437f4a7f314ae7 P 951b1cce09414daa81906c2905ce9d5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dc9fb1dd2c741feb6511c2d94617bc9 in term 0.
I20260809 03:25:46.355086 22178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87decbedbce346d19f437f4a7f314ae7" candidate_uuid: "2dc9fb1dd2c741feb6511c2d94617bc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951b1cce09414daa81906c2905ce9d5e"
I20260809 03:25:46.355136 22178 raft_consensus.cc:3037] T 87decbedbce346d19f437f4a7f314ae7 P 951b1cce09414daa81906c2905ce9d5e [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:25:46.355948 22178 raft_consensus.cc:2454] T 87decbedbce346d19f437f4a7f314ae7 P 951b1cce09414daa81906c2905ce9d5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc9fb1dd2c741feb6511c2d94617bc9 in term 1.
I20260809 03:25:46.389030 22408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:46.385261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36408 (local address 127.8.5.195:35717)
0809 03:25:46.385349 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:46.385351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:46.385360 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:25:46.385403 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:46.385404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:46.385428 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:46.385504 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:25:46.385699 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.386583 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.387907 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:46.388212 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:46.388288 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:46.388493 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:25:46.388624 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:25:46.388699 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:46.388923 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 03:25:46.388947 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 03:25:46.391245 22178 raft_consensus.cc:1261] T 87decbedbce346d19f437f4a7f314ae7 P 951b1cce09414daa81906c2905ce9d5e [term 1 FOLLOWER]: Refusing update from remote peer 2dc9fb1dd2c741feb6511c2d94617bc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:25:46.391381 22028 raft_consensus.cc:1261] T 87decbedbce346d19f437f4a7f314ae7 P 3c82bfbb6b03487786fbd7f90f36d21b [term 1 FOLLOWER]: Refusing update from remote peer 2dc9fb1dd2c741feb6511c2d94617bc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:25:46.391714 22420 consensus_queue.cc:1035] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "951b1cce09414daa81906c2905ce9d5e" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:25:46.393532 22426 consensus_queue.cc:1035] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82bfbb6b03487786fbd7f90f36d21b" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 38751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:25:46.398249 22429 mvcc.cc:205] Tried to move back new op lower bound from 7316463396415811584 to 7316463396264534016. Current Snapshot: MvccSnapshot[applied={T|T < 7316463396415811584 or (T in {7316463396415811584})}]
I20260809 03:25:46.398420 22430 mvcc.cc:205] Tried to move back new op lower bound from 7316463396415811584 to 7316463396264534016. Current Snapshot: MvccSnapshot[applied={T|T < 7316463396415811584}]
I20260809 03:25:46.399124 21866 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45364:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:25:46.399224 21866 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45364:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:25:46.399642 22432 mvcc.cc:205] Tried to move back new op lower bound from 7316463396415811584 to 7316463396264534016. Current Snapshot: MvccSnapshot[applied={T|T < 7316463396415811584 or (T in {7316463396415811584})}]
I20260809 03:25:46.399928 21866 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d66c7923a50d4685986464c83d98f9cd: Sending DeleteTablet for 3 replicas of tablet 87decbedbce346d19f437f4a7f314ae7
I20260809 03:25:46.400554 21984 tablet_service.cc:1514] Processing DeleteTablet for tablet 87decbedbce346d19f437f4a7f314ae7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:25:46 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:43332
I20260809 03:25:46.400789 22155 tablet_service.cc:1514] Processing DeleteTablet for tablet 87decbedbce346d19f437f4a7f314ae7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:25:46 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:42602
I20260809 03:25:46.400995 22292 tablet_service.cc:1514] Processing DeleteTablet for tablet 87decbedbce346d19f437f4a7f314ae7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:25:46 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:36398
I20260809 03:25:46.401609 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 21907
I20260809 03:25:46.407054 22441 tablet_replica.cc:330] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9: stopping tablet replica
I20260809 03:25:46.411077 22441 raft_consensus.cc:2229] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:25:46.411221 22441 raft_consensus.cc:2258] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 03:25:46.411423 21846 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.5.193:38751 (error 108)
I20260809 03:25:46.411464 22440 tablet_replica.cc:330] T 87decbedbce346d19f437f4a7f314ae7 P 951b1cce09414daa81906c2905ce9d5e: stopping tablet replica
I20260809 03:25:46.412024 22441 ts_tablet_manager.cc:1905] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:25:46.412312 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 22084
I20260809 03:25:46.414762 22441 ts_tablet_manager.cc:1918] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:25:46.414848 22441 log.cc:1196] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/87decbedbce346d19f437f4a7f314ae7
I20260809 03:25:46.415153 22441 ts_tablet_manager.cc:1939] T 87decbedbce346d19f437f4a7f314ae7 P 2dc9fb1dd2c741feb6511c2d94617bc9: Deleting consensus metadata
I20260809 03:25:46.415591 21848 catalog_manager.cc:4841] TS 2dc9fb1dd2c741feb6511c2d94617bc9 (127.8.5.195:35717): tablet 87decbedbce346d19f437f4a7f314ae7 (table test-table [id=ccc0bec5dd324b49bee16be7633486d9]) successfully deleted
I20260809 03:25:46.416590 22407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:46.416468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:38751 (local address 127.0.0.1:43344)
0809 03:25:46.416517 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:46.416550 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.193:38751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260809 03:25:46.416775 21846 catalog_manager.cc:4584] TS 3c82bfbb6b03487786fbd7f90f36d21b (127.8.5.193:38751): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 87decbedbce346d19f437f4a7f314ae7: Network error: Client connection negotiation failed: client connection to 127.8.5.193:38751: connect: Connection refused (error 111)
I20260809 03:25:46.419294 22407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:46.419210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:39047 (local address 127.0.0.1:42606)
0809 03:25:46.419245 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:46.419265 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.194:39047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260809 03:25:46.428617 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 22232
I20260809 03:25:46.436281 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 21828
I20260809 03:25:46.442241 8215 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 03:25:46.786100 8215 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 03:25:46.786190 8215 mini_ranger.cc:66] Stopping Ranger...
I20260809 03:25:47.130075 8215 mini_ranger.cc:68] Stopped Ranger
2026-08-09 03:25:47.130 UTC [20822] LOG: received smart shutdown request
2026-08-09 03:25:47.135 UTC [20822] LOG: background worker "logical replication launcher" (PID 20831) exited with exit code 1
2026-08-09 03:25:47.135 UTC [20826] LOG: shutting down
2026-08-09 03:25:47.304 UTC [20822] LOG: database system is shut down
2026-08-09T03:25:47Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (46848 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:25:47 dist-test-slave-2w3w krb5kdc[22452](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:25:47 dist-test-slave-2w3w krb5kdc[22452](info): set up 2 sockets
Aug 09 03:25:47 dist-test-slave-2w3w krb5kdc[22452](info): commencing operation
krb5kdc: starting...
W20260809 03:25:48.495852 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:25:48 dist-test-slave-2w3w krb5kdc[22452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:25:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:25:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:25:48.614161 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:42265
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:45995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:42265,127.8.5.253:45273,127.8.5.252:37881
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:25:48.694033 22465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:48.694235 22465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:48.694257 22465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:48.695465 22465 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:25:48.695503 22465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:48.695518 22465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:48.695576 22465 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:25:48.695602 22465 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:25:48.697116 22465 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:45995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:42265,127.8.5.253:45273,127.8.5.252:37881
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:42265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:48.697376 22465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:48.697607 22465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:48.702268 22474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:48.702281 22471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:48.702268 22472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:48.702561 22465 server_base.cc:1034] running on GCE node
I20260809 03:25:48.702840 22465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:48.703162 22465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:48.704303 22465 hybrid_clock.cc:648] HybridClock initialized: now 1786245948704283 us; error 36 us; skew 500 ppm
Aug 09 03:25:48 dist-test-slave-2w3w krb5kdc[22452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245948, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:48.706662 22465 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:25:48.707219 22465 webserver.cc:460] Webserver started at http://127.8.5.254:44113/ using document root <none> and password file <none>
I20260809 03:25:48.707450 22465 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:48.707517 22465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:48.707674 22465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:25:48.708695 22465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "c50f44799af84e70b58757befe74c7af"
format_stamp: "Formatted at 2026-08-09 03:25:48 on dist-test-slave-2w3w"
server_key: "d22d23c588c6685db8f256f5c08f00d2"
server_key_iv: "b8e3a0e850646beb649320f2064c69a7"
server_key_version: "encryptionkey@0"
I20260809 03:25:48.709075 22465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "c50f44799af84e70b58757befe74c7af"
format_stamp: "Formatted at 2026-08-09 03:25:48 on dist-test-slave-2w3w"
server_key: "d22d23c588c6685db8f256f5c08f00d2"
server_key_iv: "b8e3a0e850646beb649320f2064c69a7"
server_key_version: "encryptionkey@0"
I20260809 03:25:48.710806 22465 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 03:25:48.711624 22481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:48.711792 22465 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:25:48.711889 22465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "c50f44799af84e70b58757befe74c7af"
format_stamp: "Formatted at 2026-08-09 03:25:48 on dist-test-slave-2w3w"
server_key: "d22d23c588c6685db8f256f5c08f00d2"
server_key_iv: "b8e3a0e850646beb649320f2064c69a7"
server_key_version: "encryptionkey@0"
I20260809 03:25:48.711944 22465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:48.733196 22465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:48.735126 22465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:48.735239 22465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:48.739295 22465 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:42265
I20260809 03:25:48.739352 22540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:42265 every 8 connection(s)
I20260809 03:25:48.739693 22465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:25:48.740553 22541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:25:48.742079 22541 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 03:25:48 dist-test-slave-2w3w krb5kdc[22452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245948, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:25:48.749056 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 22465
I20260809 03:25:48.749174 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:25:48.749368 8215 external_mini_cluster.cc:1428] Setting key f80709efa2ec427792d87cdfeaa52af8
I20260809 03:25:48.751688 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.742711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:42265 (local address 127.0.0.1:58844)
0809 03:25:48.742890 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:48.742927 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:48.743411 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:48.743675 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:48.743677 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:48.743946 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:48.744100 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:48.744104 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:48.745112 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:48.745113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:48.745833 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:48.745835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:48.746275 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:48.746276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:48.746332 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:48.746763 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:48.746771 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:48.748302 (+ 1531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:48.750045 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:48.750053 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:48.750055 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:48.750339 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:48.750565 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:48.750565 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:48.750566 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:48.750675 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:48.751049 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:48.751056 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:48.751135 (+ 79us) client_negotiation.cc:769] Sending connection context
0809 03:25:48.751243 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 03:25:48.751512 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":108,"thread_start_us":87,"threads_started":1}
I20260809 03:25:48.751694 22545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.742746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58844 (local address 127.8.5.254:42265)
0809 03:25:48.742911 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:48.742919 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:48.743039 (+ 120us) server_negotiation.cc:407] Connection header received
0809 03:25:48.743549 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:48.743550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:48.743566 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:48.743645 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:48.744210 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:48.745009 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:48.745905 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:48.746205 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:48.746279 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:48.748393 (+ 2114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:48.748401 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:48.748401 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:48.748407 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:48.749945 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:48.750419 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:48.750421 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:48.750422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:48.750498 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:48.750737 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:48.750737 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:48.750738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:48.750920 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:48.751052 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:48.751292 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 03:25:48.751437 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":106,"threads_started":1}
I20260809 03:25:48.752485 22541 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:25:48.752846 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.752718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:45273 (local address 127.0.0.1:37388)
0809 03:25:48.752767 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:48.752815 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.253:45273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 03:25:48.752995 22482 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.5.253:45273: connect: Connection refused (error 111)
I20260809 03:25:48.753435 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.753323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:45273 (local address 127.0.0.1:37390)
0809 03:25:48.753375 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:48.753406 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.253:45273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 03:25:48.753597 22541 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.253:45273: Network error: Client connection negotiation failed: client connection to 127.8.5.253:45273: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.8.5.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.253.keytab.
Entry for principal kudu/127.8.5.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.253.keytab.
I20260809 03:25:48.774123 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.253:45273
--webserver_interface=127.8.5.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.253.keytab
--principal=kudu/127.8.5.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:45995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:42265,127.8.5.253:45273,127.8.5.252:37881
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 03:25:48.802858 22541 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } attempt: 1
I20260809 03:25:48.803414 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.803257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:45273 (local address 127.0.0.1:37392)
0809 03:25:48.803327 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:48.803378 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.253:45273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 03:25:48.803862 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.803754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:45273 (local address 127.0.0.1:37394)
0809 03:25:48.803808 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:48.803839 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.253:45273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 03:25:48.803997 22541 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.253:45273: Network error: Client connection negotiation failed: client connection to 127.8.5.253:45273: connect: Connection refused (error 111)
W20260809 03:25:48.856580 22549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:48.856794 22549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:48.856817 22549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:48.857985 22549 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:25:48.858032 22549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:48.858047 22549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:48.858059 22549 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:25:48.858114 22549 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:25:48.859642 22549 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:45995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:42265,127.8.5.253:45273,127.8.5.252:37881
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.253.keytab
--principal=kudu/127.8.5.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.253:45273
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.5.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:48.859911 22549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:48.860150 22549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:48.865129 22557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:48.865168 22554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:48.865149 22555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:48.865442 22549 server_base.cc:1034] running on GCE node
I20260809 03:25:48.865676 22549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:48.865967 22549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:48.867136 22549 hybrid_clock.cc:648] HybridClock initialized: now 1786245948867122 us; error 28 us; skew 500 ppm
Aug 09 03:25:48 dist-test-slave-2w3w krb5kdc[22452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245948, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:48.869694 22549 init.cc:377] Logged in from keytab as kudu/127.8.5.253@KRBTEST.COM (short username kudu)
I20260809 03:25:48.870139 22549 webserver.cc:460] Webserver started at http://127.8.5.253:36199/ using document root <none> and password file <none>
I20260809 03:25:48.870383 22549 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:48.870453 22549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:48.870601 22549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:25:48.871755 22549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-1/data/instance:
uuid: "e5cf1cf2dea44345b93951aab99afc37"
format_stamp: "Formatted at 2026-08-09 03:25:48 on dist-test-slave-2w3w"
server_key: "8640af3352ef9e87a0216be1d6277521"
server_key_iv: "e22d3fa0c39c6eda14a24ba48ceb6de9"
server_key_version: "encryptionkey@0"
I20260809 03:25:48.872131 22549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-1/wal/instance:
uuid: "e5cf1cf2dea44345b93951aab99afc37"
format_stamp: "Formatted at 2026-08-09 03:25:48 on dist-test-slave-2w3w"
server_key: "8640af3352ef9e87a0216be1d6277521"
server_key_iv: "e22d3fa0c39c6eda14a24ba48ceb6de9"
server_key_version: "encryptionkey@0"
I20260809 03:25:48.872180 22541 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } attempt: 2
I20260809 03:25:48.872578 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.872438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:45273 (local address 127.0.0.1:37404)
0809 03:25:48.872508 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:48.872546 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.253:45273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 03:25:48.872999 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.872913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:45273 (local address 127.0.0.1:37414)
0809 03:25:48.872956 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:48.872981 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.253:45273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 03:25:48.873113 22541 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.253:45273: Network error: Client connection negotiation failed: client connection to 127.8.5.253:45273: connect: Connection refused (error 111)
I20260809 03:25:48.873754 22549 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 03:25:48.874537 22564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:48.874715 22549 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:25:48.874802 22549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-1/wal
uuid: "e5cf1cf2dea44345b93951aab99afc37"
format_stamp: "Formatted at 2026-08-09 03:25:48 on dist-test-slave-2w3w"
server_key: "8640af3352ef9e87a0216be1d6277521"
server_key_iv: "e22d3fa0c39c6eda14a24ba48ceb6de9"
server_key_version: "encryptionkey@0"
I20260809 03:25:48.874861 22549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:48.890785 22549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:48.893010 22549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:48.893126 22549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:48.897040 22549 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.253:45273
I20260809 03:25:48.897094 22619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.253:45273 every 8 connection(s)
I20260809 03:25:48.897441 22549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-1/data/info.pb
I20260809 03:25:48.898334 22620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:25:48.898594 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 22549
I20260809 03:25:48.898715 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-1/wal/instance
I20260809 03:25:48.898921 8215 external_mini_cluster.cc:1428] Setting key ac6a851978c5b4ad8a0b41cbfc0d5f0b
I20260809 03:25:48.900130 22620 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 03:25:48 dist-test-slave-2w3w krb5kdc[22452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245948, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.253@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.5.252@KRBTEST.COM; defaulting to no policy
I20260809 03:25:48.909510 22545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.900922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58852 (local address 127.8.5.254:42265)
0809 03:25:48.900988 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:48.900991 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:48.901226 (+ 235us) server_negotiation.cc:407] Connection header received
0809 03:25:48.901905 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:48.901906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:48.901922 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:48.901986 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:48.902594 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:48.903461 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:48.904468 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:48.904822 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:48.904898 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:48.906934 (+ 2036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:48.906936 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:48.906936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:48.906944 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:48.908239 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:48.908597 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:48.908598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:48.908598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:48.908646 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:48.908854 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:48.908854 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:48.908855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:48.908952 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:48.909001 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:48.909385 (+ 384us) server_negotiation.cc:299] Negotiation successful
0809 03:25:48.909447 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 03:25:48.909763 22623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.900890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:42265 (local address 127.0.0.1:58852)
0809 03:25:48.901075 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:48.901124 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:48.901763 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:48.902054 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:48.902057 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:48.902312 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:48.902502 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:48.902506 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:48.903552 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:48.903553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:48.904364 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:48.904366 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:48.904918 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:48.904919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:48.905013 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:48.905527 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:48.905535 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:48.906842 (+ 1307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:48.908320 (+ 1478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:48.908327 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:48.908328 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:48.908533 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:48.908703 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:48.908703 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:48.908703 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:48.908794 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:48.909058 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:48.909065 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:48.909259 (+ 194us) client_negotiation.cc:769] Sending connection context
0809 03:25:48.909358 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 03:25:48.909473 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":91,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.252@KRBTEST.COM" created.
I20260809 03:25:48.910406 22620 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 03:25:48 dist-test-slave-2w3w krb5kdc[22452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245948, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.253@KRBTEST.COM for kudu/127.8.5.253@KRBTEST.COM
I20260809 03:25:48.918457 22623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.910696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:45273 (local address 127.0.0.1:37418)
0809 03:25:48.910915 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:48.910926 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:48.911004 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:48.911149 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:48.911150 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:48.911318 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:48.911375 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:48.911377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:48.912186 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:48.912187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:48.912944 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:48.912946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:48.913627 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:48.913627 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:48.913678 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:48.914066 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:48.914071 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:48.915308 (+ 1237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:48.917318 (+ 2010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:48.917337 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:48.917337 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:48.917495 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:48.917759 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:48.917760 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:48.917760 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:48.917822 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:48.918209 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:48.918210 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:48.918250 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 03:25:48.918320 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 03:25:48.918394 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203}
I20260809 03:25:48.918583 22624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.910771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37418 (local address 127.8.5.253:45273)
0809 03:25:48.910923 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:48.910927 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:48.911022 (+ 95us) server_negotiation.cc:407] Connection header received
0809 03:25:48.911047 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:48.911049 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:48.911062 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:48.911131 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:48.911443 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:48.912107 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:48.913031 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:48.913539 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:48.913628 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:48.915400 (+ 1772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:48.915410 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:48.915410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:48.915417 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:48.917228 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:48.917581 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:48.917584 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:48.917585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:48.917648 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:48.917902 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:48.917904 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:48.917904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:48.918097 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:48.918209 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:48.918382 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 03:25:48.918466 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":88,"threads_started":1}
I20260809 03:25:48.919301 22620 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:25:48.919648 22623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.919531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:37881 (local address 127.0.0.1:48944)
0809 03:25:48.919578 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:48.919628 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:37881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 03:25:48.919811 22565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.5.252:37881: connect: Connection refused (error 111)
I20260809 03:25:48.920258 22623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.920172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:37881 (local address 127.0.0.1:48948)
0809 03:25:48.920216 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:48.920242 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:37881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 03:25:48.920433 22620 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.252:37881: Network error: Client connection negotiation failed: client connection to 127.8.5.252:37881: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.252.keytab.
Entry for principal kudu/127.8.5.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.252.keytab.
I20260809 03:25:48.926584 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.252:37881
--webserver_interface=127.8.5.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.252.keytab
--principal=kudu/127.8.5.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:45995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:42265,127.8.5.253:45273,127.8.5.252:37881
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 03:25:48.964278 22541 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } attempt: 3
Aug 09 03:25:48 dist-test-slave-2w3w krb5kdc[22452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245948, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for kudu/127.8.5.253@KRBTEST.COM
I20260809 03:25:48.969688 22620 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } attempt: 1
I20260809 03:25:48.970207 22623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.969949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:37881 (local address 127.0.0.1:48952)
0809 03:25:48.970124 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:48.970162 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:37881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
I20260809 03:25:48.970669 22623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.970461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:37881 (local address 127.0.0.1:48968)
0809 03:25:48.970605 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:48.970631 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:37881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":84,"threads_started":1}
W20260809 03:25:48.970752 22620 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.252:37881: Network error: Client connection negotiation failed: client connection to 127.8.5.252:37881: connect: Connection refused (error 111)
I20260809 03:25:48.972038 22624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.964777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37424 (local address 127.8.5.253:45273)
0809 03:25:48.964852 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:48.964854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:48.964867 (+ 13us) server_negotiation.cc:407] Connection header received
0809 03:25:48.964945 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:48.964946 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:48.964967 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:48.965029 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:48.965381 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:48.965885 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:48.966586 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:48.966799 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:48.966878 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:48.968960 (+ 2082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:48.968962 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:48.968962 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:48.968970 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:48.970824 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:48.971220 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:48.971221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:48.971222 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:48.971294 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:48.971503 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:48.971503 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:48.971504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:48.971621 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:48.971694 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:48.971872 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 03:25:48.971951 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 03:25:48.972046 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.964672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:45273 (local address 127.0.0.1:37424)
0809 03:25:48.964740 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:48.964756 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:48.964870 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:48.965035 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:48.965036 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:48.965212 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:48.965278 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:48.965280 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:48.965971 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:48.965973 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:48.966479 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:48.966481 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:48.966875 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:48.966876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:48.966999 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:48.967538 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:48.967544 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:48.968864 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:48.970922 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:48.970924 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:48.970924 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:48.971142 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:48.971370 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:48.971371 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:48.971371 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:48.971438 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:48.971696 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:48.971698 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:48.971748 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 03:25:48.971834 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 03:25:48.971952 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 03:25:48.972383 22541 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:25:48.972723 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.972625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:37881 (local address 127.0.0.1:48972)
0809 03:25:48.972674 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:48.972699 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:37881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 03:25:48.973083 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:48.972999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:37881 (local address 127.0.0.1:48984)
0809 03:25:48.973046 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:48.973068 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:37881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 03:25:48.973184 22541 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.252:37881: Network error: Client connection negotiation failed: client connection to 127.8.5.252:37881: connect: Connection refused (error 111)
I20260809 03:25:49.004328 22541 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } attempt: 1
I20260809 03:25:49.004873 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.004711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:37881 (local address 127.0.0.1:49000)
0809 03:25:49.004779 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:49.004836 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:37881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 03:25:49.005276 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.005196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:37881 (local address 127.0.0.1:49004)
0809 03:25:49.005236 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:49.005261 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:37881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260809 03:25:49.005402 22541 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.252:37881: Network error: Client connection negotiation failed: client connection to 127.8.5.252:37881: connect: Connection refused (error 111)
W20260809 03:25:49.009891 22627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:49.010074 22627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:49.010097 22627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:49.011336 22627 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:25:49.011377 22627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:49.011392 22627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:49.011439 22627 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:25:49.011457 22627 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:25:49.012952 22627 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:45995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:42265,127.8.5.253:45273,127.8.5.252:37881
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.252.keytab
--principal=kudu/127.8.5.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.252:37881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.5.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:49.013193 22627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:49.013440 22627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:49.018362 22634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:49.018369 22637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:49.018579 22627 server_base.cc:1034] running on GCE node
W20260809 03:25:49.018386 22633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:49.018906 22627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:49.019238 22627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:49.020390 22627 hybrid_clock.cc:648] HybridClock initialized: now 1786245949020384 us; error 49 us; skew 500 ppm
Aug 09 03:25:49 dist-test-slave-2w3w krb5kdc[22452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245949, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:49.022812 22627 init.cc:377] Logged in from keytab as kudu/127.8.5.252@KRBTEST.COM (short username kudu)
I20260809 03:25:49.023356 22627 webserver.cc:460] Webserver started at http://127.8.5.252:40209/ using document root <none> and password file <none>
I20260809 03:25:49.023583 22627 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:49.023651 22627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:49.023809 22627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:25:49.024868 22627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-2/data/instance:
uuid: "18ae2a14a64b439e81e42b8578ca1bff"
format_stamp: "Formatted at 2026-08-09 03:25:49 on dist-test-slave-2w3w"
server_key: "60e5d99313ac617990dbf5b61e706932"
server_key_iv: "7513094d1dafc46ea9b080ae2562f92f"
server_key_version: "encryptionkey@0"
I20260809 03:25:49.025240 22627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-2/wal/instance:
uuid: "18ae2a14a64b439e81e42b8578ca1bff"
format_stamp: "Formatted at 2026-08-09 03:25:49 on dist-test-slave-2w3w"
server_key: "60e5d99313ac617990dbf5b61e706932"
server_key_iv: "7513094d1dafc46ea9b080ae2562f92f"
server_key_version: "encryptionkey@0"
I20260809 03:25:49.026593 22627 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:25:49.027406 22645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:49.027595 22627 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:49.027695 22627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-2/wal
uuid: "18ae2a14a64b439e81e42b8578ca1bff"
format_stamp: "Formatted at 2026-08-09 03:25:49 on dist-test-slave-2w3w"
server_key: "60e5d99313ac617990dbf5b61e706932"
server_key_iv: "7513094d1dafc46ea9b080ae2562f92f"
server_key_version: "encryptionkey@0"
I20260809 03:25:49.027772 22627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:49.038909 22620 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } attempt: 2
I20260809 03:25:49.039431 22628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.039239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:37881 (local address 127.0.0.1:49006)
0809 03:25:49.039316 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:49.039384 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:37881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 03:25:49.039847 22628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.039762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:37881 (local address 127.0.0.1:49012)
0809 03:25:49.039806 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:49.039830 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:37881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 03:25:49.039975 22620 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.252:37881: Network error: Client connection negotiation failed: client connection to 127.8.5.252:37881: connect: Connection refused (error 111)
I20260809 03:25:49.049743 22627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:49.052788 22627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:49.052960 22627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:49.057287 22627 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.252:37881
I20260809 03:25:49.057345 22703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.252:37881 every 8 connection(s)
I20260809 03:25:49.057672 22627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-2/data/info.pb
I20260809 03:25:49.058513 22704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:25:49.060113 22704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:25:49.061836 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 22627
I20260809 03:25:49.061949 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786245797426041-8215-0/minicluster-data/master-2/wal/instance
I20260809 03:25:49.062141 8215 external_mini_cluster.cc:1428] Setting key 4acff3b939864b53baf1df9c345a4318
Aug 09 03:25:49 dist-test-slave-2w3w krb5kdc[22452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245949, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.252@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
Aug 09 03:25:49 dist-test-slave-2w3w krb5kdc[22452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.252@KRBTEST.COM
I20260809 03:25:49.070243 22545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.060837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58864 (local address 127.8.5.254:42265)
0809 03:25:49.060915 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:49.060918 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:49.061076 (+ 158us) server_negotiation.cc:407] Connection header received
0809 03:25:49.061519 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:49.061520 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:49.061533 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:49.061601 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:49.062567 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.063173 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.064587 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.064774 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.064868 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:49.067153 (+ 2285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:49.067154 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:49.067154 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:49.067162 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:49.068789 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.069219 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.069220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.069220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.069277 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.069570 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.069570 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.069571 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.069679 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:49.069731 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:49.070109 (+ 378us) server_negotiation.cc:299] Negotiation successful
0809 03:25:49.070180 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 03:25:49.070488 22706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.060778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:42265 (local address 127.0.0.1:58864)
0809 03:25:49.060962 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:49.060998 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:49.061423 (+ 425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:49.061703 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:49.061708 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:49.062124 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:49.062398 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:49.062423 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.063281 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.063282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:49.064505 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:49.064507 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.064877 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.064878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:49.065046 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:49.065534 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:49.065545 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:49.067071 (+ 1526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:49.068872 (+ 1801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:49.068879 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:49.068880 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:49.069142 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:49.069368 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:49.069368 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:49.069369 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:49.069496 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:49.069747 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:49.069754 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:49.069927 (+ 173us) client_negotiation.cc:769] Sending connection context
0809 03:25:49.070061 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 03:25:49.070247 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":104,"threads_started":1}
I20260809 03:25:49.071357 22704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:25:49.072511 22708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.062533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49014 (local address 127.8.5.252:37881)
0809 03:25:49.062712 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:49.062716 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:49.063430 (+ 714us) server_negotiation.cc:407] Connection header received
0809 03:25:49.063486 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:49.063489 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:49.063507 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:49.063569 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:49.064273 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.064958 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.065980 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.066261 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.066349 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:49.069082 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:49.069088 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:49.069088 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:49.069094 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:49.071078 (+ 1984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.071671 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.071676 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.071676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.071738 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.071960 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.071961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.071961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.072101 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:49.072275 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:49.072317 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 03:25:49.072400 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":102,"threads_started":1}
Aug 09 03:25:49 dist-test-slave-2w3w krb5kdc[22452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245949, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.252@KRBTEST.COM for kudu/127.8.5.253@KRBTEST.COM
Aug 09 03:25:49 dist-test-slave-2w3w krb5kdc[22452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:25:49.078613 22706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.071637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:45273 (local address 127.0.0.1:37428)
0809 03:25:49.071687 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:49.071698 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:49.071736 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:49.071864 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:49.071865 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:49.072008 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:49.072035 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:49.072036 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.072749 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.072750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:49.073458 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:49.073461 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.073785 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.073786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:49.073862 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:49.074233 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:49.074237 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:49.075440 (+ 1203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:49.077607 (+ 2167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:49.077608 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:49.077609 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:49.077790 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:49.077991 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:49.077992 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:49.077992 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:49.078053 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:49.078317 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:49.078318 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:49.078358 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 03:25:49.078434 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 03:25:49.078525 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
I20260809 03:25:49.078637 22624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.071722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37428 (local address 127.8.5.253:45273)
0809 03:25:49.071770 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:49.071772 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:49.071780 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:25:49.071805 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:49.071806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:49.071814 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:49.071863 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:49.072116 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.072672 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.073539 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.073714 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.073764 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:49.075527 (+ 1763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:49.075528 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:49.075529 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:49.075534 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:49.077491 (+ 1957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.077872 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.077873 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.077873 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.077919 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.078133 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.078134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.078134 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.078245 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:49.078313 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:49.078474 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 03:25:49.078547 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 03:25:49.079326 22704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:25:49.080536 22541 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } attempt: 2
I20260809 03:25:49.081305 22545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.073230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58868 (local address 127.8.5.254:42265)
0809 03:25:49.073262 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:49.073263 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:49.073271 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:25:49.073299 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:49.073300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:49.073306 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:49.073349 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:49.073863 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.074435 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.075287 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.075587 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.075636 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:49.078256 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:49.078257 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:49.078257 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:49.078264 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:49.080075 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.080362 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.080363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.080363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.080420 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.080590 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.080591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.080592 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.080723 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:49.080905 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:49.081099 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 03:25:49.081206 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
Aug 09 03:25:49 dist-test-slave-2w3w krb5kdc[22452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245949, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.252@KRBTEST.COM for kudu/127.8.5.252@KRBTEST.COM
Aug 09 03:25:49 dist-test-slave-2w3w krb5kdc[22452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245948, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for kudu/127.8.5.252@KRBTEST.COM
Aug 09 03:25:49 dist-test-slave-2w3w krb5kdc[22452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.253@KRBTEST.COM
I20260809 03:25:49.087175 22706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.079560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:37881 (local address 127.0.0.1:49030)
0809 03:25:49.079611 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:49.079623 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:49.079665 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:49.079795 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:49.079796 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:49.079908 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:49.079934 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:49.079935 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.080704 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.080705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:49.081621 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:49.081623 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.082134 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.082135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:49.082191 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:49.082589 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:49.082594 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:49.083880 (+ 1286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:49.086123 (+ 2243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:49.086123 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:49.086124 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:49.086296 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:49.086498 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:49.086499 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:49.086499 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:49.086553 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:49.086831 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:49.086832 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:49.086867 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 03:25:49.086921 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 03:25:49.087053 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 03:25:49.087298 22708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.079632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49030 (local address 127.8.5.252:37881)
0809 03:25:49.079686 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:49.079688 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:49.079710 (+ 22us) server_negotiation.cc:407] Connection header received
0809 03:25:49.079729 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:49.079729 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:49.079739 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:49.079793 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:49.080001 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.080642 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.081702 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.082037 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.082093 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:49.083976 (+ 1883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:49.083977 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:49.083977 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:49.083983 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:49.086043 (+ 2060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.086372 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.086373 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.086374 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.086431 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.086629 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.086630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.086630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.086754 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:49.086833 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:49.086985 (+ 152us) server_negotiation.cc:299] Negotiation successful
0809 03:25:49.087143 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":37}
I20260809 03:25:49.088917 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.080728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:37881 (local address 127.0.0.1:49044)
0809 03:25:49.080766 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:49.080777 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:49.080810 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:49.081143 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:49.081144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:49.081308 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:49.081346 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:49.081348 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.082246 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.082247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:49.082720 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:49.082721 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.083220 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.083221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:49.083278 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:49.083656 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:49.083662 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:49.085093 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:49.087840 (+ 2747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:49.087841 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:49.087842 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:49.088049 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:49.088263 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:49.088264 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:49.088264 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:49.088319 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:49.088619 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:49.088621 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:49.088667 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 03:25:49.088714 (+ 47us) client_negotiation.cc:240] Negotiation successful
0809 03:25:49.088809 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260809 03:25:49.089145 22704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff: Bootstrap starting.
I20260809 03:25:49.089288 22710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.080883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49044 (local address 127.8.5.252:37881)
0809 03:25:49.081021 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:49.081023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:49.081030 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:25:49.081049 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:49.081055 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:49.081062 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:49.081139 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:49.081456 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.082170 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.082800 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.083129 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.083411 (+ 282us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:49.085164 (+ 1753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:49.085165 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:49.085166 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:49.085172 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:49.087751 (+ 2579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.088133 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.088134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.088134 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.088188 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.088401 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.088401 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.088402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.088538 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:49.089054 (+ 516us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:49.089096 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 03:25:49.089172 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
I20260809 03:25:49.089798 22704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff: Neither blocks nor log segments found. Creating new log.
I20260809 03:25:49.090104 22704 log.cc:824] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:49.090946 22704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff: No bootstrap required, opened a new log
I20260809 03:25:49.091187 22624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.081892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37432 (local address 127.8.5.253:45273)
0809 03:25:49.081924 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:49.081925 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:49.081933 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:25:49.081972 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:49.081972 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:49.081980 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:49.082032 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:49.082912 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.083613 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.084506 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.084812 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.084883 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:49.088041 (+ 3158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:49.088042 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:49.088042 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:49.088050 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:49.089758 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.090118 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.090119 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.090119 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.090172 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.090401 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.090402 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.090402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.090527 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:49.090709 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:49.090934 (+ 225us) server_negotiation.cc:299] Negotiation successful
0809 03:25:49.091101 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 03:25:49.091737 22541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af: Bootstrap starting.
I20260809 03:25:49.092391 22541 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af: Neither blocks nor log segments found. Creating new log.
I20260809 03:25:49.092679 22541 log.cc:824] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:49.092760 22704 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } }
I20260809 03:25:49.092928 22704 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:25:49.092981 22704 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18ae2a14a64b439e81e42b8578ca1bff, State: Initialized, Role: FOLLOWER
I20260809 03:25:49.093297 22704 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } }
I20260809 03:25:49.093607 22541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af: No bootstrap required, opened a new log
I20260809 03:25:49.093648 22704 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:25:49.093595 22713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } } }
I20260809 03:25:49.093804 22713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:25:49.094350 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:25:49.095885 22541 raft_consensus.cc:348] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } }
I20260809 03:25:49.096012 22541 raft_consensus.cc:374] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:25:49.096060 22541 raft_consensus.cc:729] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c50f44799af84e70b58757befe74c7af, State: Initialized, Role: FOLLOWER
I20260809 03:25:49.096171 22541 consensus_queue.cc:260] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } }
I20260809 03:25:49.096417 22729 sys_catalog.cc:455] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } } }
I20260809 03:25:49.096472 22541 sys_catalog.cc:564] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af [sys.catalog]: configured and running, proceeding with master startup.
W20260809 03:25:49.098068 22724 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:25:49.098121 22724 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:25:49.095785 22627 master_runner.cc:186] Error getting master registration for 127.8.5.254:42265: OK, instance_id { permanent_uuid: "c50f44799af84e70b58757befe74c7af" instance_seqno: 1786245948738066 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 03:25:49.098250 22627 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 03:25:49.097862 22729 sys_catalog.cc:458] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af [sys.catalog]: This master's current role is: FOLLOWER
W20260809 03:25:49.098363 22744 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:25:49.098418 22744 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:25:49.099159 22465 master_runner.cc:186] Error getting master registration for 127.8.5.253:45273: OK, instance_id { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" instance_seqno: 1786245948895941 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 03:25:49.102205 22465 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 03:25:49.108683 22710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.097457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49046 (local address 127.8.5.252:37881)
0809 03:25:49.097494 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:49.097496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:49.099048 (+ 1552us) server_negotiation.cc:407] Connection header received
0809 03:25:49.099196 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:49.099197 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:49.099209 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:49.099261 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:49.100104 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.100854 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.103470 (+ 2616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.103800 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.103838 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:49.105527 (+ 1689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:49.105528 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:49.105528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:49.105536 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:49.107372 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.107774 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.107775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.107775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.107857 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.108057 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.108058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.108058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.108193 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:49.108282 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:49.108490 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 03:25:49.108574 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:25:49.108892 22545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.096696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58882 (local address 127.8.5.254:42265)
0809 03:25:49.096732 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:49.096733 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:49.098785 (+ 2052us) server_negotiation.cc:407] Connection header received
0809 03:25:49.099221 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:49.099222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:49.099231 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:49.099260 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:49.101987 (+ 2727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.102535 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.103432 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.103715 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.103772 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:49.105527 (+ 1755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:49.105528 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:49.105528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:49.105536 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:49.107688 (+ 2152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.108070 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.108071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.108072 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.108120 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.108317 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.108318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.108318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.108459 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:49.108522 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:49.108711 (+ 189us) server_negotiation.cc:299] Negotiation successful
0809 03:25:49.108786 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 03:25:49.114621 22624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.097088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37434 (local address 127.8.5.253:45273)
0809 03:25:49.097131 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:49.097133 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:49.098898 (+ 1765us) server_negotiation.cc:407] Connection header received
0809 03:25:49.098944 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:49.098945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:49.098973 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:49.099030 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:49.100411 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.101078 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.102078 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.102381 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.102425 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:49.111939 (+ 9514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:49.111941 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:49.111941 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:49.111948 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:49.113420 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.113769 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.113771 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.113771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.113870 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.114061 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.114062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.114063 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.114173 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:49.114269 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:49.114420 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 03:25:49.114499 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:25:49.131134 22620 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } attempt: 3
Aug 09 03:25:49 dist-test-slave-2w3w krb5kdc[22452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245948, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.253@KRBTEST.COM for kudu/127.8.5.252@KRBTEST.COM
I20260809 03:25:49.140044 22628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.131431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:37881 (local address 127.0.0.1:49050)
0809 03:25:49.131480 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:49.131491 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:49.131542 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:49.131689 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:49.131690 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:49.131859 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:49.131915 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:49.131917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.132571 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.132572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:49.133320 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:49.133323 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.134232 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.134233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:49.134311 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:49.134856 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:49.134862 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:49.136642 (+ 1780us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:49.138688 (+ 2046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:49.138689 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:49.138690 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:49.138937 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:49.139309 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:49.139310 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:49.139310 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:49.139389 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:49.139697 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:49.139698 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:49.139746 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 03:25:49.139811 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 03:25:49.139923 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 03:25:49.140952 22710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:49.131480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49050 (local address 127.8.5.252:37881)
0809 03:25:49.131550 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:49.131552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:49.131563 (+ 11us) server_negotiation.cc:407] Connection header received
0809 03:25:49.131597 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:49.131598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:49.131607 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:49.131673 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:49.131997 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.132479 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.133826 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:49.134098 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:49.134167 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:49.136746 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:49.136747 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:49.136748 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:49.136756 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:49.138589 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.139161 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.139162 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.139163 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.139232 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:49.139466 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:49.139467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:49.139468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:49.139609 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:49.139669 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:49.140745 (+ 1076us) server_negotiation.cc:299] Negotiation successful
0809 03:25:49.140833 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 03:25:49.142900 22620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37: Bootstrap starting.
I20260809 03:25:49.143934 22620 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37: Neither blocks nor log segments found. Creating new log.
I20260809 03:25:49.144285 22620 log.cc:824] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:49.145205 22620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37: No bootstrap required, opened a new log
I20260809 03:25:49.147231 22620 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } }
I20260809 03:25:49.147372 22620 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:25:49.147408 22620 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5cf1cf2dea44345b93951aab99afc37, State: Initialized, Role: FOLLOWER
I20260809 03:25:49.147529 22620 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } }
I20260809 03:25:49.147779 22748 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } } }
I20260809 03:25:49.147848 22620 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 03:25:49.150749 22760 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:25:49.150884 22760 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:25:49.151983 22549 master_runner.cc:263] No leader master found from master e5cf1cf2dea44345b93951aab99afc37
I20260809 03:25:49.152040 22549 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 03:25:49.147925 22748 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:25:49.170781 22748 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:25:49.170899 22748 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } }
I20260809 03:25:49.171339 22511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e5cf1cf2dea44345b93951aab99afc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c50f44799af84e70b58757befe74c7af" is_pre_election: true
I20260809 03:25:49.171490 22511 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5cf1cf2dea44345b93951aab99afc37 in term 0.
I20260809 03:25:49.171676 22565 leader_election.cc:302] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c50f44799af84e70b58757befe74c7af, e5cf1cf2dea44345b93951aab99afc37; no voters:
I20260809 03:25:49.172114 22674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e5cf1cf2dea44345b93951aab99afc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18ae2a14a64b439e81e42b8578ca1bff" is_pre_election: true
I20260809 03:25:49.172264 22674 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5cf1cf2dea44345b93951aab99afc37 in term 0.
I20260809 03:25:49.172436 22748 leader_election.cc:288] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c50f44799af84e70b58757befe74c7af (127.8.5.254:42265), 18ae2a14a64b439e81e42b8578ca1bff (127.8.5.252:37881)
I20260809 03:25:49.172526 22748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:25:49.172570 22748 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:25:49.172597 22748 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:25:49.173532 22748 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } }
I20260809 03:25:49.173794 22511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e5cf1cf2dea44345b93951aab99afc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c50f44799af84e70b58757befe74c7af"
I20260809 03:25:49.173897 22511 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:25:49.174787 22511 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5cf1cf2dea44345b93951aab99afc37 in term 1.
I20260809 03:25:49.174996 22565 leader_election.cc:302] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c50f44799af84e70b58757befe74c7af, e5cf1cf2dea44345b93951aab99afc37; no voters:
I20260809 03:25:49.175190 22674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e5cf1cf2dea44345b93951aab99afc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18ae2a14a64b439e81e42b8578ca1bff"
I20260809 03:25:49.175271 22674 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:25:49.176025 22674 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5cf1cf2dea44345b93951aab99afc37 in term 1.
I20260809 03:25:49.176206 22748 leader_election.cc:288] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [CANDIDATE]: Term 1 election: Requested vote from peers c50f44799af84e70b58757befe74c7af (127.8.5.254:42265), 18ae2a14a64b439e81e42b8578ca1bff (127.8.5.252:37881)
I20260809 03:25:49.176273 22748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:25:49.176317 22748 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [term 1 LEADER]: Becoming Leader. State: Replica: e5cf1cf2dea44345b93951aab99afc37, State: Running, Role: LEADER
I20260809 03:25:49.176404 22748 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } }
I20260809 03:25:49.176857 22748 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5cf1cf2dea44345b93951aab99afc37. Latest consensus state: current_term: 1 leader_uuid: "e5cf1cf2dea44345b93951aab99afc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } } }
I20260809 03:25:49.176936 22748 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [sys.catalog]: This master's current role is: LEADER
I20260809 03:25:49.177140 22764 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:25:49.177413 22764 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:25:49.179352 22674 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff [term 1 FOLLOWER]: Refusing update from remote peer e5cf1cf2dea44345b93951aab99afc37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:25:49.179657 22762 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:25:49.180859 22713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5cf1cf2dea44345b93951aab99afc37. Latest consensus state: current_term: 1 leader_uuid: "e5cf1cf2dea44345b93951aab99afc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } } }
I20260809 03:25:49.180943 22713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:25:49.181282 22511 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af [term 1 FOLLOWER]: Refusing update from remote peer e5cf1cf2dea44345b93951aab99afc37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:25:49.181551 22762 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:25:49.182634 22729 sys_catalog.cc:455] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5cf1cf2dea44345b93951aab99afc37. Latest consensus state: current_term: 1 leader_uuid: "e5cf1cf2dea44345b93951aab99afc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } } }
I20260809 03:25:49.182725 22729 sys_catalog.cc:458] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:25:49.184650 22762 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5cf1cf2dea44345b93951aab99afc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } } }
I20260809 03:25:49.184736 22762 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [sys.catalog]: This master's current role is: LEADER
I20260809 03:25:49.185122 22729 sys_catalog.cc:455] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5cf1cf2dea44345b93951aab99afc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } } }
I20260809 03:25:49.185202 22729 sys_catalog.cc:458] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:25:49.185452 22765 mvcc.cc:205] Tried to move back new op lower bound from 7316463407836360704 to 7316463407827341312. Current Snapshot: MvccSnapshot[applied={T|T < 7316463407836360704}]
I20260809 03:25:49.185635 22769 mvcc.cc:205] Tried to move back new op lower bound from 7316463407836360704 to 7316463407827341312. Current Snapshot: MvccSnapshot[applied={T|T < 7316463407836360704}]
I20260809 03:25:49.186311 22748 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5cf1cf2dea44345b93951aab99afc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } } }
I20260809 03:25:49.186400 22748 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37 [sys.catalog]: This master's current role is: LEADER
I20260809 03:25:49.186692 22713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5cf1cf2dea44345b93951aab99afc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c50f44799af84e70b58757befe74c7af" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42265 } } peers { permanent_uuid: "e5cf1cf2dea44345b93951aab99afc37" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 45273 } } peers { permanent_uuid: "18ae2a14a64b439e81e42b8578ca1bff" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 37881 } } }
I20260809 03:25:49.186775 22713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:25:49.187443 22766 mvcc.cc:205] Tried to move back new op lower bound from 7316463407836360704 to 7316463407827341312. Current Snapshot: MvccSnapshot[applied={T|T < 7316463407836360704}]
I20260809 03:25:49.188274 22764 catalog_manager.cc:1347] Generated new cluster ID: 81af62fcd97f46f4a2983a700ccb7b96
I20260809 03:25:49.188333 22764 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:25:49.201128 22764 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:25:49.201830 22764 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:25:49.211114 22764 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e5cf1cf2dea44345b93951aab99afc37: Generated new TSK 0
I20260809 03:25:49.211285 22764 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:25:50.098585 22724 catalog_manager.cc:1259] Loaded cluster ID: 81af62fcd97f46f4a2983a700ccb7b96
I20260809 03:25:50.098681 22724 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff: loading cluster ID for follower catalog manager: success
I20260809 03:25:50.098826 22744 catalog_manager.cc:1259] Loaded cluster ID: 81af62fcd97f46f4a2983a700ccb7b96
I20260809 03:25:50.098882 22744 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af: loading cluster ID for follower catalog manager: success
I20260809 03:25:50.099968 22744 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af: acquiring CA information for follower catalog manager: success
I20260809 03:25:50.099983 22724 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff: acquiring CA information for follower catalog manager: success
I20260809 03:25:50.100306 22724 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 18ae2a14a64b439e81e42b8578ca1bff: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 03:25:50.100312 22744 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c50f44799af84e70b58757befe74c7af: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 03:25:50.269491 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 22465
I20260809 03:25:50.276294 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 22549
I20260809 03:25:50.283193 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 22627
2026-08-09T03:25:50Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2858 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:25:50 dist-test-slave-2w3w krb5kdc[22785](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:25:50 dist-test-slave-2w3w krb5kdc[22785](info): set up 2 sockets
Aug 09 03:25:50 dist-test-slave-2w3w krb5kdc[22785](info): commencing operation
krb5kdc: starting...
W20260809 03:25:51.356652 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.053s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:25:51 dist-test-slave-2w3w krb5kdc[22785](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245951, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:25:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:25:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:25:51.478015 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:45667
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:45667
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:25:51.557708 22798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:51.557897 22798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:51.557919 22798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:51.559047 22798 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:25:51.559084 22798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:51.559098 22798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:51.559139 22798 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:25:51.559168 22798 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:25:51.560503 22798 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:45667
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:45667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:51.560741 22798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:51.560998 22798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:51.565796 22803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:51.565936 22798 server_base.cc:1034] running on GCE node
W20260809 03:25:51.565864 22807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:51.565788 22805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:51.566252 22798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:51.566479 22798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:51.567670 22798 hybrid_clock.cc:648] HybridClock initialized: now 1786245951567654 us; error 38 us; skew 500 ppm
Aug 09 03:25:51 dist-test-slave-2w3w krb5kdc[22785](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245951, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:51.572896 22798 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:25:51.573331 22798 webserver.cc:460] Webserver started at http://127.8.5.254:43393/ using document root <none> and password file <none>
I20260809 03:25:51.573522 22798 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:51.573561 22798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:51.573645 22798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:25:51.574577 22798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "9503768d9ca54a3dad3eddb1d9b02dcd"
format_stamp: "Formatted at 2026-08-09 03:25:51 on dist-test-slave-2w3w"
server_key: "efd3775d5dff505cc1e4fdd51fbe1a92"
server_key_iv: "54a808f6ca4c3637f14a57f43f6b1df9"
server_key_version: "encryptionkey@0"
I20260809 03:25:51.574879 22798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "9503768d9ca54a3dad3eddb1d9b02dcd"
format_stamp: "Formatted at 2026-08-09 03:25:51 on dist-test-slave-2w3w"
server_key: "efd3775d5dff505cc1e4fdd51fbe1a92"
server_key_iv: "54a808f6ca4c3637f14a57f43f6b1df9"
server_key_version: "encryptionkey@0"
I20260809 03:25:51.576185 22798 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:25:51.576906 22814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:51.577069 22798 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:25:51.577167 22798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "9503768d9ca54a3dad3eddb1d9b02dcd"
format_stamp: "Formatted at 2026-08-09 03:25:51 on dist-test-slave-2w3w"
server_key: "efd3775d5dff505cc1e4fdd51fbe1a92"
server_key_iv: "54a808f6ca4c3637f14a57f43f6b1df9"
server_key_version: "encryptionkey@0"
I20260809 03:25:51.577241 22798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:51.619688 22798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:51.622462 22798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:51.622577 22798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:51.626621 22798 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:45667
I20260809 03:25:51.626690 22873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:45667 every 8 connection(s)
I20260809 03:25:51.627095 22798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:25:51.628034 22874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:25:51.630266 22874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd: Bootstrap starting.
I20260809 03:25:51.630853 22874 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd: Neither blocks nor log segments found. Creating new log.
I20260809 03:25:51.631204 22874 log.cc:824] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:51.631886 22874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd: No bootstrap required, opened a new log
I20260809 03:25:51.632946 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 22798
I20260809 03:25:51.633021 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:25:51.633194 8215 external_mini_cluster.cc:1428] Setting key c5f95d7777d57a76ebced7ff359430b8
I20260809 03:25:51.633651 22874 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9503768d9ca54a3dad3eddb1d9b02dcd" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45667 } }
I20260809 03:25:51.633886 22874 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:25:51.633944 22874 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9503768d9ca54a3dad3eddb1d9b02dcd, State: Initialized, Role: FOLLOWER
I20260809 03:25:51.634078 22874 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9503768d9ca54a3dad3eddb1d9b02dcd" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45667 } }
I20260809 03:25:51.634143 22874 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:25:51.634163 22874 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:25:51.634227 22874 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:25:51.635166 22874 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9503768d9ca54a3dad3eddb1d9b02dcd" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45667 } }
I20260809 03:25:51.635284 22874 leader_election.cc:302] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9503768d9ca54a3dad3eddb1d9b02dcd; no voters:
I20260809 03:25:51.635483 22874 leader_election.cc:288] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:25:51.635517 22879 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:25:51.635622 22879 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd [term 1 LEADER]: Becoming Leader. State: Replica: 9503768d9ca54a3dad3eddb1d9b02dcd, State: Running, Role: LEADER
I20260809 03:25:51.635749 22874 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:25:51.635766 22879 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9503768d9ca54a3dad3eddb1d9b02dcd" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45667 } }
I20260809 03:25:51.636198 22879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9503768d9ca54a3dad3eddb1d9b02dcd. Latest consensus state: current_term: 1 leader_uuid: "9503768d9ca54a3dad3eddb1d9b02dcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9503768d9ca54a3dad3eddb1d9b02dcd" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45667 } } }
I20260809 03:25:51.636204 22880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9503768d9ca54a3dad3eddb1d9b02dcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9503768d9ca54a3dad3eddb1d9b02dcd" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45667 } } }
I20260809 03:25:51.636459 22880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd [sys.catalog]: This master's current role is: LEADER
I20260809 03:25:51.636384 22879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd [sys.catalog]: This master's current role is: LEADER
I20260809 03:25:51.636729 22888 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:25:51.637277 22888 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:25:51.638634 22888 catalog_manager.cc:1347] Generated new cluster ID: 8df29a5435c2435192a199d6b7424be6
I20260809 03:25:51.638687 22888 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 03:25:51 dist-test-slave-2w3w krb5kdc[22785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245951, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:25:51.643711 22878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:51.633691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36806 (local address 127.8.5.254:45667)
0809 03:25:51.633913 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:51.633923 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:51.633954 (+ 31us) server_negotiation.cc:407] Connection header received
0809 03:25:51.634064 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:51.634071 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:51.634120 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:51.634277 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:51.635042 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:51.636298 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:51.637379 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:51.637859 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:51.637969 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:51.640449 (+ 2480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:51.640453 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:51.640453 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:51.640464 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:51.642110 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:51.642487 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:51.642490 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:51.642491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:51.642588 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:51.642815 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:51.642816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:51.642817 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:51.643116 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:51.643311 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:51.643380 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 03:25:51.643519 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":110,"threads_started":1}
I20260809 03:25:51.644718 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:25:51.661115 22888 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:25:51.661773 22888 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:25:51.666536 22888 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9503768d9ca54a3dad3eddb1d9b02dcd: Generated new TSK 0
I20260809 03:25:51.666693 22888 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:25:51.698637 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 22798
2026-08-09T03:25:51Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1414 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:25:51 dist-test-slave-2w3w krb5kdc[22904](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:25:51 dist-test-slave-2w3w krb5kdc[22904](info): set up 2 sockets
Aug 09 03:25:51 dist-test-slave-2w3w krb5kdc[22904](info): commencing operation
krb5kdc: starting...
W20260809 03:25:52.767999 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:25:52 dist-test-slave-2w3w krb5kdc[22904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245952, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:25:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:25:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:25:52.889911 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:33341
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:33341
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:25:52.970635 22918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:52.970866 22918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:52.970907 22918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:52.972045 22918 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:25:52.972113 22918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:52.972138 22918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:52.972159 22918 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:25:52.972190 22918 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:25:52.973656 22918 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:33341
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:33341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22918
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:52.973932 22918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:52.974196 22918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:52.979019 22926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:52.979053 22928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:52.979024 22925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:52.979174 22918 server_base.cc:1034] running on GCE node
I20260809 03:25:52.979434 22918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:52.979664 22918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:52.980804 22918 hybrid_clock.cc:648] HybridClock initialized: now 1786245952980786 us; error 38 us; skew 500 ppm
Aug 09 03:25:52 dist-test-slave-2w3w krb5kdc[22904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245952, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:52.983206 22918 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:25:52.983618 22918 webserver.cc:460] Webserver started at http://127.8.5.254:35393/ using document root <none> and password file <none>
I20260809 03:25:52.983862 22918 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:52.983943 22918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:52.984087 22918 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:25:52.985082 22918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "d3f497a84fc042bea35cdbaec75e0be0"
format_stamp: "Formatted at 2026-08-09 03:25:52 on dist-test-slave-2w3w"
server_key: "568c96672da935004e594c6e39abce81"
server_key_iv: "4157e892d2afa81f5702fc9a2bc5c119"
server_key_version: "encryptionkey@0"
I20260809 03:25:52.985425 22918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "d3f497a84fc042bea35cdbaec75e0be0"
format_stamp: "Formatted at 2026-08-09 03:25:52 on dist-test-slave-2w3w"
server_key: "568c96672da935004e594c6e39abce81"
server_key_iv: "4157e892d2afa81f5702fc9a2bc5c119"
server_key_version: "encryptionkey@0"
I20260809 03:25:52.986701 22918 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:25:52.987479 22935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:52.987654 22918 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:52.987753 22918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "d3f497a84fc042bea35cdbaec75e0be0"
format_stamp: "Formatted at 2026-08-09 03:25:52 on dist-test-slave-2w3w"
server_key: "568c96672da935004e594c6e39abce81"
server_key_iv: "4157e892d2afa81f5702fc9a2bc5c119"
server_key_version: "encryptionkey@0"
I20260809 03:25:52.987838 22918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:52.999852 22918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:53.001914 22918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:53.002070 22918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:53.006359 22918 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:33341
I20260809 03:25:53.006394 22991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:33341 every 8 connection(s)
I20260809 03:25:53.006728 22918 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:25:53.007721 22993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:25:53.010082 22993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0: Bootstrap starting.
I20260809 03:25:53.010639 22993 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0: Neither blocks nor log segments found. Creating new log.
I20260809 03:25:53.011013 22993 log.cc:824] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:53.011713 22993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0: No bootstrap required, opened a new log
I20260809 03:25:53.013319 22993 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3f497a84fc042bea35cdbaec75e0be0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33341 } }
I20260809 03:25:53.013456 22993 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:25:53.013478 22993 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3f497a84fc042bea35cdbaec75e0be0, State: Initialized, Role: FOLLOWER
I20260809 03:25:53.013667 22993 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3f497a84fc042bea35cdbaec75e0be0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33341 } }
I20260809 03:25:53.013749 22993 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:25:53.013792 22993 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:25:53.013847 22993 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:25:53.014676 22993 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3f497a84fc042bea35cdbaec75e0be0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33341 } }
I20260809 03:25:53.014777 22993 leader_election.cc:302] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3f497a84fc042bea35cdbaec75e0be0; no voters:
I20260809 03:25:53.015034 22993 leader_election.cc:288] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:25:53.015075 22996 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:25:53.015110 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 22918
I20260809 03:25:53.015219 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:25:53.015223 22996 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 1 LEADER]: Becoming Leader. State: Replica: d3f497a84fc042bea35cdbaec75e0be0, State: Running, Role: LEADER
I20260809 03:25:53.015295 22993 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:25:53.015306 22996 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3f497a84fc042bea35cdbaec75e0be0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33341 } }
I20260809 03:25:53.015434 8215 external_mini_cluster.cc:1428] Setting key 7ca6bc4d07831f2a647366441381e4ab
I20260809 03:25:53.015681 22996 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3f497a84fc042bea35cdbaec75e0be0. Latest consensus state: current_term: 1 leader_uuid: "d3f497a84fc042bea35cdbaec75e0be0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3f497a84fc042bea35cdbaec75e0be0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33341 } } }
I20260809 03:25:53.015753 22996 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [sys.catalog]: This master's current role is: LEADER
I20260809 03:25:53.015955 22998 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3f497a84fc042bea35cdbaec75e0be0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3f497a84fc042bea35cdbaec75e0be0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33341 } } }
I20260809 03:25:53.016037 22998 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [sys.catalog]: This master's current role is: LEADER
W20260809 03:25:53.017333 23015 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:25:53.017400 23015 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:25:53.017474 23003 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:25:53.017681 23003 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:25:53.019326 23003 catalog_manager.cc:1347] Generated new cluster ID: c25be0721ede4c0b855c5b0518464e3a
I20260809 03:25:53.019379 23003 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 03:25:53 dist-test-slave-2w3w krb5kdc[22904](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245952, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:25:53.028657 23004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.015870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43416 (local address 127.8.5.254:33341)
0809 03:25:53.016199 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:53.016208 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:53.017176 (+ 968us) server_negotiation.cc:407] Connection header received
0809 03:25:53.017367 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:53.017374 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:53.017431 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:53.017576 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:53.018513 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.019873 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.020994 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.021599 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.021692 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.024626 (+ 2934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:53.024630 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:53.024630 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:53.024641 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:53.027015 (+ 2374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:53.027432 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:53.027434 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:53.027435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:53.027565 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:53.027777 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:53.027778 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:53.027778 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:53.028062 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:53.028195 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:53.028316 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 03:25:53.028440 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":76,"threads_started":1}
I20260809 03:25:53.035226 23003 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:25:53.035728 23003 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:25:53.043643 23003 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0: Generated new TSK 0
I20260809 03:25:53.043889 23003 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
I20260809 03:25:53.077092 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33341
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:25:53.157913 23021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:53.158107 23021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:53.158129 23021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:53.159192 23021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:53.159226 23021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:53.159252 23021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:25:53.160601 23021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:53.160784 23021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:53.160952 23021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:53.165828 23030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:53.166008 23021 server_base.cc:1034] running on GCE node
W20260809 03:25:53.166078 23028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:53.165855 23027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:53.166323 23021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:53.166564 23021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:53.167728 23021 hybrid_clock.cc:648] HybridClock initialized: now 1786245953167721 us; error 33 us; skew 500 ppm
Aug 09 03:25:53 dist-test-slave-2w3w krb5kdc[22904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245953, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:53.170156 23021 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:25:53.170621 23021 webserver.cc:460] Webserver started at http://127.8.5.193:32947/ using document root <none> and password file <none>
I20260809 03:25:53.170857 23021 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:53.170928 23021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:53.171087 23021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:25:53.172132 23021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "648b3e0f3a1444d589cca788758d04d5"
format_stamp: "Formatted at 2026-08-09 03:25:53 on dist-test-slave-2w3w"
server_key: "e014afba800953ad837b3358b6c7c015"
server_key_iv: "9a82ff378914feafd3422c72bd99ec80"
server_key_version: "encryptionkey@0"
I20260809 03:25:53.172503 23021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "648b3e0f3a1444d589cca788758d04d5"
format_stamp: "Formatted at 2026-08-09 03:25:53 on dist-test-slave-2w3w"
server_key: "e014afba800953ad837b3358b6c7c015"
server_key_iv: "9a82ff378914feafd3422c72bd99ec80"
server_key_version: "encryptionkey@0"
I20260809 03:25:53.173797 23021 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:25:53.174556 23037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:53.174753 23021 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:25:53.174890 23021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "648b3e0f3a1444d589cca788758d04d5"
format_stamp: "Formatted at 2026-08-09 03:25:53 on dist-test-slave-2w3w"
server_key: "e014afba800953ad837b3358b6c7c015"
server_key_iv: "9a82ff378914feafd3422c72bd99ec80"
server_key_version: "encryptionkey@0"
I20260809 03:25:53.175006 23021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:53.186051 23021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:53.187884 23021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:53.188052 23021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:53.188275 23021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:25:53.188582 23021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:25:53.188637 23021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:53.188679 23021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:25:53.188709 23021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:53.194809 23021 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:37723
I20260809 03:25:53.194856 23160 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:37723 every 8 connection(s)
I20260809 03:25:53.195204 23021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
Aug 09 03:25:53 dist-test-slave-2w3w krb5kdc[22904](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245953, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:25:53.201802 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 23021
I20260809 03:25:53.202023 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:25:53.202232 8215 external_mini_cluster.cc:1428] Setting key ca3e8590aa237987a95119729cedea3f
I20260809 03:25:53.204563 23004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.195921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:51913 (local address 127.8.5.254:33341)
0809 03:25:53.195969 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:53.195970 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:53.196210 (+ 240us) server_negotiation.cc:407] Connection header received
0809 03:25:53.196734 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:53.196735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:53.196747 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:53.196818 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:53.197733 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.198250 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.199284 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.199508 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.199595 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.201647 (+ 2052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:53.201653 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:53.201653 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:53.201660 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:53.203164 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:53.203584 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:53.203585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:53.203586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:53.203648 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:53.203915 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:53.203916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:53.203916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:53.204031 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:53.204108 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:53.204385 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 03:25:53.204474 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 03:25:53.204744 23163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.195906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:51913)
0809 03:25:53.196087 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:53.196122 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:53.196628 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:53.196890 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:53.196898 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:53.197446 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:53.197628 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.197632 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.198359 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.198360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.199185 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.199188 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.199608 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.199609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.199734 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.200156 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:53.200163 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:53.201525 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:53.203278 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:53.203286 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:53.203288 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:53.203507 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:53.203721 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:53.203722 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:53.203722 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:53.203840 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:53.204099 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:53.204107 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:53.204244 (+ 137us) client_negotiation.cc:769] Sending connection context
0809 03:25:53.204349 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 03:25:53.204502 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":92,"threads_started":1}
I20260809 03:25:53.205407 23161 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33341
I20260809 03:25:53.205515 23161 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:53.205709 23161 heartbeater.cc:511] Master 127.8.5.254:33341 requested a full tablet report, sending...
I20260809 03:25:53.206211 22953 ts_manager.cc:194] Registered new tserver with Master: 648b3e0f3a1444d589cca788758d04d5 (127.8.5.193:37723)
I20260809 03:25:53.206820 22953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:51913
WARNING: no policy specified for kudu/127.8.5.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
I20260809 03:25:53.229143 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33341
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:25:53.309288 23166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:53.309537 23166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:53.309579 23166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:53.310734 23166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:53.310799 23166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:53.310851 23166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:25:53.312378 23166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:53.312654 23166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:53.312902 23166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 03:25:53.318135 23166 server_base.cc:1034] running on GCE node
W20260809 03:25:53.318104 23172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:53.318095 23171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:53.318104 23174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:53.318595 23166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:53.318907 23166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:53.320088 23166 hybrid_clock.cc:648] HybridClock initialized: now 1786245953320077 us; error 29 us; skew 500 ppm
Aug 09 03:25:53 dist-test-slave-2w3w krb5kdc[22904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245953, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:53.322445 23166 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:25:53.322882 23166 webserver.cc:460] Webserver started at http://127.8.5.194:41455/ using document root <none> and password file <none>
I20260809 03:25:53.323132 23166 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:53.323203 23166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:53.323367 23166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:25:53.324358 23166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "e69c0534f5d743ad992646c174b03418"
format_stamp: "Formatted at 2026-08-09 03:25:53 on dist-test-slave-2w3w"
server_key: "d9283b231106f930a4a638d3ed6952cb"
server_key_iv: "c0b56f892ae1f0da5d5f0d3eda550e08"
server_key_version: "encryptionkey@0"
I20260809 03:25:53.324712 23166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "e69c0534f5d743ad992646c174b03418"
format_stamp: "Formatted at 2026-08-09 03:25:53 on dist-test-slave-2w3w"
server_key: "d9283b231106f930a4a638d3ed6952cb"
server_key_iv: "c0b56f892ae1f0da5d5f0d3eda550e08"
server_key_version: "encryptionkey@0"
I20260809 03:25:53.326000 23166 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:25:53.326689 23182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:53.326861 23166 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:25:53.326969 23166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "e69c0534f5d743ad992646c174b03418"
format_stamp: "Formatted at 2026-08-09 03:25:53 on dist-test-slave-2w3w"
server_key: "d9283b231106f930a4a638d3ed6952cb"
server_key_iv: "c0b56f892ae1f0da5d5f0d3eda550e08"
server_key_version: "encryptionkey@0"
I20260809 03:25:53.327069 23166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:53.341105 23166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:53.342828 23166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:53.343050 23166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:53.343281 23166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:25:53.343588 23166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:25:53.343641 23166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:53.343681 23166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:25:53.343709 23166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:53.349511 23166 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:44673
I20260809 03:25:53.349548 23306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:44673 every 8 connection(s)
I20260809 03:25:53.349879 23166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:25:53.353816 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 23166
I20260809 03:25:53.353951 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:25:53.354131 8215 external_mini_cluster.cc:1428] Setting key f30211093b2cd31a8e8c12f9c74378e1
Aug 09 03:25:53 dist-test-slave-2w3w krb5kdc[22904](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245953, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:25:53.359391 23004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.350660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:34299 (local address 127.8.5.254:33341)
0809 03:25:53.350726 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:53.350728 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:53.350935 (+ 207us) server_negotiation.cc:407] Connection header received
0809 03:25:53.351396 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:53.351397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:53.351408 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:53.351472 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:53.352358 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.352847 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.353785 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.354066 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.354159 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.356590 (+ 2431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:53.356592 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:53.356592 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:53.356601 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:53.357999 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:53.358446 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:53.358446 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:53.358447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:53.358495 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:53.358761 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:53.358761 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:53.358761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:53.358870 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:53.358920 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:53.359260 (+ 340us) server_negotiation.cc:299] Negotiation successful
0809 03:25:53.359325 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 03:25:53.359720 23309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.350627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:34299)
0809 03:25:53.350774 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:53.350821 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:53.351308 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:53.351523 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:53.351526 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:53.352085 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:53.352268 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.352272 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.352928 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.352928 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.353686 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.353688 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.354171 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.354172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.354324 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.354884 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:53.354895 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:53.356496 (+ 1601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:53.358061 (+ 1565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:53.358069 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:53.358071 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:53.358371 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:53.358560 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:53.358560 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:53.358561 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:53.358701 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:53.358932 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:53.358938 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:53.359124 (+ 186us) client_negotiation.cc:769] Sending connection context
0809 03:25:53.359238 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 03:25:53.359430 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":79,"threads_started":1}
I20260809 03:25:53.360204 23307 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33341
I20260809 03:25:53.360289 23307 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:53.360478 23307 heartbeater.cc:511] Master 127.8.5.254:33341 requested a full tablet report, sending...
I20260809 03:25:53.360886 22953 ts_manager.cc:194] Registered new tserver with Master: e69c0534f5d743ad992646c174b03418 (127.8.5.194:44673)
I20260809 03:25:53.361462 22953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:34299
WARNING: no policy specified for kudu/127.8.5.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
I20260809 03:25:53.382411 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33341
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:25:53.463099 23312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:53.463285 23312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:53.463308 23312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:53.464375 23312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:53.464409 23312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:53.464435 23312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:25:53.465785 23312 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:33341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:53.465958 23312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:53.466140 23312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:53.470903 23317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:53.470994 23312 server_base.cc:1034] running on GCE node
W20260809 03:25:53.470933 23320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:53.470940 23318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:53.471343 23312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:53.471539 23312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:53.472667 23312 hybrid_clock.cc:648] HybridClock initialized: now 1786245953472658 us; error 25 us; skew 500 ppm
Aug 09 03:25:53 dist-test-slave-2w3w krb5kdc[22904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245953, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:53.475138 23312 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:25:53.475520 23312 webserver.cc:460] Webserver started at http://127.8.5.195:46475/ using document root <none> and password file <none>
I20260809 03:25:53.475708 23312 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:53.475749 23312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:53.475833 23312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:25:53.476780 23312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "dd0d243d220f4403baeaf4b1af73c1ec"
format_stamp: "Formatted at 2026-08-09 03:25:53 on dist-test-slave-2w3w"
server_key: "c3e44bac1e4f517be62412a8c3b7253b"
server_key_iv: "820291501b916ac84c7d11cd73acbeec"
server_key_version: "encryptionkey@0"
I20260809 03:25:53.477167 23312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "dd0d243d220f4403baeaf4b1af73c1ec"
format_stamp: "Formatted at 2026-08-09 03:25:53 on dist-test-slave-2w3w"
server_key: "c3e44bac1e4f517be62412a8c3b7253b"
server_key_iv: "820291501b916ac84c7d11cd73acbeec"
server_key_version: "encryptionkey@0"
I20260809 03:25:53.478533 23312 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 03:25:53.479269 23329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:53.479494 23312 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:25:53.479588 23312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "dd0d243d220f4403baeaf4b1af73c1ec"
format_stamp: "Formatted at 2026-08-09 03:25:53 on dist-test-slave-2w3w"
server_key: "c3e44bac1e4f517be62412a8c3b7253b"
server_key_iv: "820291501b916ac84c7d11cd73acbeec"
server_key_version: "encryptionkey@0"
I20260809 03:25:53.479666 23312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:53.494724 23312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:53.496524 23312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:53.496681 23312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:53.496903 23312 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:25:53.497251 23312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:25:53.497304 23312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:53.497354 23312 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:25:53.497380 23312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:53.503240 23312 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:45773
I20260809 03:25:53.503278 23450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:45773 every 8 connection(s)
I20260809 03:25:53.503615 23312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:25:53.507390 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 23312
I20260809 03:25:53.507480 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:25:53.507704 8215 external_mini_cluster.cc:1428] Setting key e9ce618634657b51cc0e3882e99d0f11
Aug 09 03:25:53 dist-test-slave-2w3w krb5kdc[22904](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245953, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:25:53.512619 23004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.504329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:33749 (local address 127.8.5.254:33341)
0809 03:25:53.504414 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:53.504416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:53.504572 (+ 156us) server_negotiation.cc:407] Connection header received
0809 03:25:53.505041 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:53.505042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:53.505052 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:53.505110 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:53.505987 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.506458 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.507634 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.507902 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.507981 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.510230 (+ 2249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:53.510232 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:53.510232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:53.510239 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:53.511465 (+ 1226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:53.511877 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:53.511877 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:53.511878 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:53.511926 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:53.512130 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:53.512130 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:53.512130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:53.512227 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:53.512277 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:53.512494 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 03:25:53.512554 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 03:25:53.512794 23453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.504274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:33749)
0809 03:25:53.504451 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:53.504491 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:53.504951 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:53.505184 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:53.505187 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:53.505741 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:53.505916 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.505920 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.506532 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.506533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.507496 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.507500 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.508020 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.508021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.508176 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.508714 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:53.508724 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:53.510147 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:53.511551 (+ 1404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:53.511557 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:53.511559 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:53.511804 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:53.511983 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:53.511984 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:53.511984 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:53.512076 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:53.512279 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:53.512283 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:53.512387 (+ 104us) client_negotiation.cc:769] Sending connection context
0809 03:25:53.512466 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 03:25:53.512573 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":109,"threads_started":1}
I20260809 03:25:53.513252 23451 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33341
I20260809 03:25:53.513334 23451 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:53.513466 23451 heartbeater.cc:511] Master 127.8.5.254:33341 requested a full tablet report, sending...
I20260809 03:25:53.513779 22953 ts_manager.cc:194] Registered new tserver with Master: dd0d243d220f4403baeaf4b1af73c1ec (127.8.5.195:45773)
I20260809 03:25:53.514109 22953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:33749
I20260809 03:25:53.519364 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:25:53.526228 23004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.520671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43418 (local address 127.8.5.254:33341)
0809 03:25:53.520735 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:53.520736 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:53.520771 (+ 35us) server_negotiation.cc:407] Connection header received
0809 03:25:53.520821 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:53.520821 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:53.520829 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:53.520871 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:53.521394 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.521856 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.522598 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.522786 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.522871 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.524010 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:53.524011 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:53.524011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:53.524018 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:53.525074 (+ 1056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:53.525406 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:53.525407 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:53.525407 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:53.525465 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:53.525669 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:53.525670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:53.525670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:53.525808 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:53.525912 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:53.526053 (+ 141us) server_negotiation.cc:299] Negotiation successful
0809 03:25:53.526132 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 03:25:53.527796 22953 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43418:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:25:53.529228 22953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:25:53.535650 23463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.531482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:45773 (local address 127.0.0.1:43896)
0809 03:25:53.531659 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:53.531670 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:53.531721 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:53.531924 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:53.531925 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:53.531928 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:25:53.531988 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.531990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.533214 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.533215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.534396 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.534399 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.535322 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.535324 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.535408 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.535424 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 03:25:53.535497 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 03:25:53.535555 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":8,"thread_start_us":39,"threads_started":1}
I20260809 03:25:53.536001 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.531302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:44673 (local address 127.0.0.1:47188)
0809 03:25:53.531637 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:53.531645 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:53.531685 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:53.532106 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:53.532107 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:53.532109 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:25:53.532153 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.532154 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.533066 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.533067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.534396 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.534399 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.535752 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.535753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.535814 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.535817 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:25:53.535888 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 03:25:53.535935 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"mutex_wait_us":11,"thread_start_us":56,"threads_started":1}
I20260809 03:25:53.536334 23462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.531394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47188 (local address 127.8.5.194:44673)
0809 03:25:53.531842 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:53.531846 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:53.531855 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:25:53.531898 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:53.531900 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:53.531915 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:53.532225 (+ 310us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:25:53.532300 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.532962 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.534489 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.535236 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.535313 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.535373 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:53.536193 (+ 820us) server_negotiation.cc:299] Negotiation successful
0809 03:25:53.536245 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":85,"threads_started":1}
I20260809 03:25:53.536724 23465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.531624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43896 (local address 127.8.5.195:45773)
0809 03:25:53.531789 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:53.531793 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:53.531802 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:25:53.531833 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:53.531834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:53.531848 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:53.531927 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:25:53.532055 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.533106 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.534487 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.535236 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.535327 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.535374 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:53.536591 (+ 1217us) server_negotiation.cc:299] Negotiation successful
0809 03:25:53.536636 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":78,"threads_started":1}
I20260809 03:25:53.537060 23464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.531486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57894 (local address 127.8.5.193:37723)
0809 03:25:53.531634 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:53.531639 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:53.531651 (+ 12us) server_negotiation.cc:407] Connection header received
0809 03:25:53.531695 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:53.531697 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:53.531712 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:53.531786 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:25:53.531985 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.533107 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.535520 (+ 2413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.536346 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.536421 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.536477 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:53.536923 (+ 446us) server_negotiation.cc:299] Negotiation successful
0809 03:25:53.536972 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":77,"threads_started":1}
I20260809 03:25:53.537009 23236 tablet_service.cc:1467] Processing CreateTablet for tablet c85df735fd6745c19f43886d735e46c2 (DEFAULT_TABLE table=test-table [id=d3aba60698d94798a86fbe9e9617850a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:25:53.537271 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.531301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:37723 (local address 127.0.0.1:57894)
0809 03:25:53.531456 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:53.531491 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:53.531550 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:53.531804 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:53.531808 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:53.531810 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:25:53.531896 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.531897 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.534502 (+ 2605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.534503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.535259 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.535261 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.536576 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.536577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.536650 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.536654 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:25:53.536709 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 03:25:53.536745 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":60,"threads_started":1}
I20260809 03:25:53.537384 23236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c85df735fd6745c19f43886d735e46c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:25:53.537338 23381 tablet_service.cc:1467] Processing CreateTablet for tablet c85df735fd6745c19f43886d735e46c2 (DEFAULT_TABLE table=test-table [id=d3aba60698d94798a86fbe9e9617850a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:25:53.537652 23381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c85df735fd6745c19f43886d735e46c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:25:53.540236 23466 tablet_bootstrap.cc:492] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418: Bootstrap starting.
I20260809 03:25:53.540510 23467 tablet_bootstrap.cc:492] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec: Bootstrap starting.
I20260809 03:25:53.540980 23466 tablet_bootstrap.cc:654] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418: Neither blocks nor log segments found. Creating new log.
I20260809 03:25:53.540990 23092 tablet_service.cc:1467] Processing CreateTablet for tablet c85df735fd6745c19f43886d735e46c2 (DEFAULT_TABLE table=test-table [id=d3aba60698d94798a86fbe9e9617850a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:25:53.541147 23467 tablet_bootstrap.cc:654] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec: Neither blocks nor log segments found. Creating new log.
I20260809 03:25:53.541317 23092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c85df735fd6745c19f43886d735e46c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:25:53.541535 23466 log.cc:824] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:53.541675 23467 log.cc:824] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:53.542366 23467 tablet_bootstrap.cc:492] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec: No bootstrap required, opened a new log
I20260809 03:25:53.542380 23466 tablet_bootstrap.cc:492] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418: No bootstrap required, opened a new log
I20260809 03:25:53.542441 23466 ts_tablet_manager.cc:1397] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:25:53.542448 23467 ts_tablet_manager.cc:1397] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:25:53.543951 23467 raft_consensus.cc:348] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } }
I20260809 03:25:53.544126 23467 raft_consensus.cc:374] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:25:53.544162 23467 raft_consensus.cc:729] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd0d243d220f4403baeaf4b1af73c1ec, State: Initialized, Role: FOLLOWER
I20260809 03:25:53.544294 23467 consensus_queue.cc:260] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } }
I20260809 03:25:53.544595 23467 ts_tablet_manager.cc:1428] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:25:53.544489 23466 raft_consensus.cc:348] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } }
I20260809 03:25:53.544595 23451 heartbeater.cc:503] Master 127.8.5.254:33341 was elected leader, sending a full tablet report...
I20260809 03:25:53.544662 23466 raft_consensus.cc:374] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:25:53.544718 23466 raft_consensus.cc:729] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e69c0534f5d743ad992646c174b03418, State: Initialized, Role: FOLLOWER
I20260809 03:25:53.544823 23466 consensus_queue.cc:260] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } }
I20260809 03:25:53.545073 23466 ts_tablet_manager.cc:1428] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 03:25:53.545244 23307 heartbeater.cc:503] Master 127.8.5.254:33341 was elected leader, sending a full tablet report...
I20260809 03:25:53.545380 23471 tablet_bootstrap.cc:492] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5: Bootstrap starting.
I20260809 03:25:53.546037 23471 tablet_bootstrap.cc:654] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5: Neither blocks nor log segments found. Creating new log.
I20260809 03:25:53.546559 23471 log.cc:824] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:53.547273 23471 tablet_bootstrap.cc:492] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5: No bootstrap required, opened a new log
I20260809 03:25:53.547343 23471 ts_tablet_manager.cc:1397] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:25:53.548568 23471 raft_consensus.cc:348] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } }
I20260809 03:25:53.548693 23471 raft_consensus.cc:374] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:25:53.548713 23471 raft_consensus.cc:729] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 648b3e0f3a1444d589cca788758d04d5, State: Initialized, Role: FOLLOWER
I20260809 03:25:53.548817 23471 consensus_queue.cc:260] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } }
I20260809 03:25:53.549046 23471 ts_tablet_manager.cc:1428] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 03:25:53.549116 23161 heartbeater.cc:503] Master 127.8.5.254:33341 was elected leader, sending a full tablet report...
W20260809 03:25:53.600473 23308 tablet.cc:2369] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:25:53.618341 23475 raft_consensus.cc:482] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:25:53.618520 23475 raft_consensus.cc:504] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } }
I20260809 03:25:53.618983 23475 leader_election.cc:288] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e69c0534f5d743ad992646c174b03418 (127.8.5.194:44673), dd0d243d220f4403baeaf4b1af73c1ec (127.8.5.195:45773)
I20260809 03:25:53.621840 23462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.619250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:58209 (local address 127.8.5.194:44673)
0809 03:25:53.619295 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:53.619297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:53.619307 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:25:53.619402 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:53.619403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:53.619415 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:53.619486 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:25:53.619648 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.620112 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.621126 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.621499 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.621582 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.621592 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:53.621737 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 03:25:53.621774 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 03:25:53.621848 23163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.619170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:44673 (local address 127.8.5.193:58209)
0809 03:25:53.619251 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:53.619264 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:53.619314 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:53.619496 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:53.619497 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:53.619498 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:25:53.619568 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.619572 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.620200 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.620201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.621033 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.621035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.621582 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.621583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.621664 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.621667 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:25:53.621732 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 03:25:53.621771 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 03:25:53.621924 23465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.619246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:55855 (local address 127.8.5.195:45773)
0809 03:25:53.619291 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:53.619293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:53.619502 (+ 209us) server_negotiation.cc:407] Connection header received
0809 03:25:53.619570 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:53.619571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:53.619584 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:53.619638 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:25:53.619796 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.620257 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.621201 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.621567 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.621648 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.621657 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:53.621808 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 03:25:53.621851 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 03:25:53.622020 23476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.619183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:45773 (local address 127.8.5.193:55855)
0809 03:25:53.619414 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:53.619424 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:53.619514 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:53.619647 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:53.619648 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:53.619649 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:25:53.619728 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.619729 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.620345 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.620346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.621108 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.621110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.621649 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.621650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.621735 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.621738 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:25:53.621803 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 03:25:53.621840 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":112,"threads_started":1}
I20260809 03:25:53.622212 23257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c85df735fd6745c19f43886d735e46c2" candidate_uuid: "648b3e0f3a1444d589cca788758d04d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e69c0534f5d743ad992646c174b03418" is_pre_election: true
I20260809 03:25:53.622354 23257 raft_consensus.cc:2454] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 648b3e0f3a1444d589cca788758d04d5 in term 0.
I20260809 03:25:53.622565 23040 leader_election.cc:302] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 648b3e0f3a1444d589cca788758d04d5, e69c0534f5d743ad992646c174b03418; no voters:
I20260809 03:25:53.622720 23475 raft_consensus.cc:2781] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:25:53.622771 23475 raft_consensus.cc:482] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:25:53.622707 23402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c85df735fd6745c19f43886d735e46c2" candidate_uuid: "648b3e0f3a1444d589cca788758d04d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" is_pre_election: true
I20260809 03:25:53.622793 23475 raft_consensus.cc:3037] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:25:53.622865 23402 raft_consensus.cc:2454] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 648b3e0f3a1444d589cca788758d04d5 in term 0.
I20260809 03:25:53.623694 23475 raft_consensus.cc:504] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } }
I20260809 03:25:53.623832 23475 leader_election.cc:288] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 1 election: Requested vote from peers e69c0534f5d743ad992646c174b03418 (127.8.5.194:44673), dd0d243d220f4403baeaf4b1af73c1ec (127.8.5.195:45773)
I20260809 03:25:53.623978 23257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c85df735fd6745c19f43886d735e46c2" candidate_uuid: "648b3e0f3a1444d589cca788758d04d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e69c0534f5d743ad992646c174b03418"
I20260809 03:25:53.623992 23402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c85df735fd6745c19f43886d735e46c2" candidate_uuid: "648b3e0f3a1444d589cca788758d04d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd0d243d220f4403baeaf4b1af73c1ec"
I20260809 03:25:53.624060 23402 raft_consensus.cc:3037] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:25:53.624060 23257 raft_consensus.cc:3037] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:25:53.624950 23402 raft_consensus.cc:2454] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 648b3e0f3a1444d589cca788758d04d5 in term 1.
I20260809 03:25:53.624950 23257 raft_consensus.cc:2454] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 648b3e0f3a1444d589cca788758d04d5 in term 1.
I20260809 03:25:53.625165 23041 leader_election.cc:302] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 648b3e0f3a1444d589cca788758d04d5, dd0d243d220f4403baeaf4b1af73c1ec; no voters:
I20260809 03:25:53.625348 23475 raft_consensus.cc:2781] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:25:53.625524 23475 raft_consensus.cc:686] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [term 1 LEADER]: Becoming Leader. State: Replica: 648b3e0f3a1444d589cca788758d04d5, State: Running, Role: LEADER
I20260809 03:25:53.625666 23475 consensus_queue.cc:237] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } }
I20260809 03:25:53.626670 22953 catalog_manager.cc:5495] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 648b3e0f3a1444d589cca788758d04d5 (127.8.5.193). New cstate: current_term: 1 leader_uuid: "648b3e0f3a1444d589cca788758d04d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } health_report { overall_health: UNKNOWN } } }
I20260809 03:25:53.650388 23464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.648308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57900 (local address 127.8.5.193:37723)
0809 03:25:53.648345 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:53.648347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:53.648364 (+ 17us) server_negotiation.cc:407] Connection header received
0809 03:25:53.648438 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:53.648439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:53.648455 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:53.648516 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:25:53.648617 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.649063 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.649763 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.649945 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.649994 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.650125 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:25:53.650212 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:25:53.650269 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:53.650302 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 03:25:53.650318 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 03:25:53.652132 23257 raft_consensus.cc:1261] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418 [term 1 FOLLOWER]: Refusing update from remote peer 648b3e0f3a1444d589cca788758d04d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:25:53.652145 23402 raft_consensus.cc:1261] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec [term 1 FOLLOWER]: Refusing update from remote peer 648b3e0f3a1444d589cca788758d04d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:25:53.652506 23475 consensus_queue.cc:1035] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:25:53.652657 23477 consensus_queue.cc:1035] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:25:53.657032 22952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:25:53.657121 22952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:25:53.657855 22952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0: Sending DeleteTablet for 3 replicas of tablet c85df735fd6745c19f43886d735e46c2
I20260809 03:25:53.658195 23236 tablet_service.cc:1514] Processing DeleteTablet for tablet c85df735fd6745c19f43886d735e46c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:25:53 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:47188
I20260809 03:25:53.658229 23092 tablet_service.cc:1514] Processing DeleteTablet for tablet c85df735fd6745c19f43886d735e46c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:25:53 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:57894
I20260809 03:25:53.658435 23494 tablet_replica.cc:330] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418: stopping tablet replica
I20260809 03:25:53.658430 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 23021
I20260809 03:25:53.658447 23493 tablet_replica.cc:330] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5: stopping tablet replica
I20260809 03:25:53.658524 23494 raft_consensus.cc:2229] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:25:53.658536 23493 raft_consensus.cc:2229] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:25:53.658628 23494 raft_consensus.cc:2258] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:25:53.658628 23493 raft_consensus.cc:2258] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:25:53.660068 23494 ts_tablet_manager.cc:1905] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:25:53.662142 23494 ts_tablet_manager.cc:1918] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:25:53.662209 23494 log.cc:1196] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/c85df735fd6745c19f43886d735e46c2
I20260809 03:25:53.662494 23494 ts_tablet_manager.cc:1939] T c85df735fd6745c19f43886d735e46c2 P e69c0534f5d743ad992646c174b03418: Deleting consensus metadata
I20260809 03:25:53.663621 22938 catalog_manager.cc:4841] TS e69c0534f5d743ad992646c174b03418 (127.8.5.194:44673): tablet c85df735fd6745c19f43886d735e46c2 (table test-table [id=d3aba60698d94798a86fbe9e9617850a]) successfully deleted
I20260809 03:25:53.663765 23381 tablet_service.cc:1514] Processing DeleteTablet for tablet c85df735fd6745c19f43886d735e46c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:25:53 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:43896
I20260809 03:25:53.663985 23496 tablet_replica.cc:330] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec: stopping tablet replica
I20260809 03:25:53.664088 23496 raft_consensus.cc:2229] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:25:53.664188 23496 raft_consensus.cc:2258] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:25:53.664558 23496 ts_tablet_manager.cc:1905] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:25:53.666059 23496 ts_tablet_manager.cc:1918] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:25:53.666118 23496 log.cc:1196] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/c85df735fd6745c19f43886d735e46c2
I20260809 03:25:53.666368 23496 ts_tablet_manager.cc:1939] T c85df735fd6745c19f43886d735e46c2 P dd0d243d220f4403baeaf4b1af73c1ec: Deleting consensus metadata
I20260809 03:25:53.666740 22939 catalog_manager.cc:4841] TS dd0d243d220f4403baeaf4b1af73c1ec (127.8.5.195:45773): tablet c85df735fd6745c19f43886d735e46c2 (table test-table [id=d3aba60698d94798a86fbe9e9617850a]) successfully deleted
W20260809 03:25:53.668241 22939 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.5.193:37723 (error 108)
I20260809 03:25:53.668383 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 23166
I20260809 03:25:53.670863 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.670737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:37723 (local address 127.0.0.1:57916)
0809 03:25:53.670795 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:53.670835 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.193:37723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 03:25:53.671042 22939 catalog_manager.cc:4584] TS 648b3e0f3a1444d589cca788758d04d5 (127.8.5.193:37723): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c85df735fd6745c19f43886d735e46c2: Network error: Client connection negotiation failed: client connection to 127.8.5.193:37723: connect: Connection refused (error 111)
I20260809 03:25:53.674336 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 23312
I20260809 03:25:53.680009 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 22918
I20260809 03:25:53.686759 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:33341
--webserver_interface=127.8.5.254
--webserver_port=35393
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:33341
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:25:53.767549 23498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:53.767764 23498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:53.767809 23498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:53.768949 23498 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:25:53.769012 23498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:53.769035 23498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:53.769057 23498 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:25:53.769085 23498 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:25:53.770484 23498 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:33341
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:33341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=35393
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:53.770749 23498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:53.770998 23498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:53.780004 23506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:53.779965 23509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:53.780290 23498 server_base.cc:1034] running on GCE node
W20260809 03:25:53.779965 23505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:53.780583 23498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:53.780923 23498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:53.782081 23498 hybrid_clock.cc:648] HybridClock initialized: now 1786245953782073 us; error 47 us; skew 500 ppm
Aug 09 03:25:53 dist-test-slave-2w3w krb5kdc[22904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245953, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:53.784521 23498 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:25:53.784956 23498 webserver.cc:460] Webserver started at http://127.8.5.254:35393/ using document root <none> and password file <none>
I20260809 03:25:53.785193 23498 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:53.785276 23498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:53.786576 23498 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:25:53.787285 23516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:53.787453 23498 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:53.787576 23498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "d3f497a84fc042bea35cdbaec75e0be0"
format_stamp: "Formatted at 2026-08-09 03:25:52 on dist-test-slave-2w3w"
server_key: "568c96672da935004e594c6e39abce81"
server_key_iv: "4157e892d2afa81f5702fc9a2bc5c119"
server_key_version: "encryptionkey@0"
I20260809 03:25:53.787947 23498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:53.797961 23498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:53.799885 23498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:53.800037 23498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:53.804174 23498 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:33341
I20260809 03:25:53.804222 23572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:33341 every 8 connection(s)
I20260809 03:25:53.804615 23498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:25:53.806263 23573 sys_catalog.cc:263] Verifying existing consensus state
I20260809 03:25:53.806933 23573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0: Bootstrap starting.
I20260809 03:25:53.811981 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 23498
I20260809 03:25:53.812261 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:37723
--local_ip_for_outbound_sockets=127.8.5.193
--tserver_master_addrs=127.8.5.254:33341
--webserver_port=32947
--webserver_interface=127.8.5.193
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 03:25:53.816182 23573 log.cc:824] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:53.818112 23573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 03:25:53.818395 23573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0: Bootstrap complete.
I20260809 03:25:53.820991 23573 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3f497a84fc042bea35cdbaec75e0be0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33341 } }
I20260809 03:25:53.821237 23573 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3f497a84fc042bea35cdbaec75e0be0, State: Initialized, Role: FOLLOWER
I20260809 03:25:53.821426 23573 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3f497a84fc042bea35cdbaec75e0be0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33341 } }
I20260809 03:25:53.821486 23573 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:25:53.821550 23573 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:25:53.821624 23573 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 1 FOLLOWER]: Advancing to term 2
I20260809 03:25:53.822682 23573 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3f497a84fc042bea35cdbaec75e0be0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33341 } }
I20260809 03:25:53.822775 23573 leader_election.cc:302] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3f497a84fc042bea35cdbaec75e0be0; no voters:
I20260809 03:25:53.823204 23573 leader_election.cc:288] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 03:25:53.823240 23577 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 03:25:53.823374 23577 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 2 LEADER]: Becoming Leader. State: Replica: d3f497a84fc042bea35cdbaec75e0be0, State: Running, Role: LEADER
I20260809 03:25:53.823506 23573 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:25:53.823482 23577 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3f497a84fc042bea35cdbaec75e0be0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33341 } }
I20260809 03:25:53.823769 23580 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3f497a84fc042bea35cdbaec75e0be0. Latest consensus state: current_term: 2 leader_uuid: "d3f497a84fc042bea35cdbaec75e0be0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3f497a84fc042bea35cdbaec75e0be0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33341 } } }
I20260809 03:25:53.823975 23580 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [sys.catalog]: This master's current role is: LEADER
I20260809 03:25:53.823918 23578 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d3f497a84fc042bea35cdbaec75e0be0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3f497a84fc042bea35cdbaec75e0be0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33341 } } }
I20260809 03:25:53.824229 23578 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [sys.catalog]: This master's current role is: LEADER
I20260809 03:25:53.824311 23587 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:25:53.825140 23587 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:25:53.825241 23587 catalog_manager.cc:1259] Loaded cluster ID: c25be0721ede4c0b855c5b0518464e3a
I20260809 03:25:53.825284 23587 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:25:53.825556 23587 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 03:25:53.828465 23587 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 03:25:53.830220 23587 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:25:53.830416 23587 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0: Loaded TSK: 0
I20260809 03:25:53.830628 23587 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 03:25:53.905759 23575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:53.905965 23575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:53.905989 23575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:53.907310 23575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:53.907364 23575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:53.907407 23575 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:25:53.908900 23575 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:37723
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=32947
--tserver_master_addrs=127.8.5.254:33341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:53.909138 23575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:53.909408 23575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:53.914314 23605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:53.914342 23608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:53.914314 23604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:53.914767 23575 server_base.cc:1034] running on GCE node
I20260809 03:25:53.915023 23575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:53.915272 23575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:53.916436 23575 hybrid_clock.cc:648] HybridClock initialized: now 1786245953916422 us; error 31 us; skew 500 ppm
Aug 09 03:25:53 dist-test-slave-2w3w krb5kdc[22904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245953, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:53.919260 23575 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:25:53.919795 23575 webserver.cc:460] Webserver started at http://127.8.5.193:32947/ using document root <none> and password file <none>
I20260809 03:25:53.920079 23575 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:53.920164 23575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:53.921943 23575 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:25:53.922708 23615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:53.922935 23575 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:25:53.923055 23575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "648b3e0f3a1444d589cca788758d04d5"
format_stamp: "Formatted at 2026-08-09 03:25:53 on dist-test-slave-2w3w"
server_key: "e014afba800953ad837b3358b6c7c015"
server_key_iv: "9a82ff378914feafd3422c72bd99ec80"
server_key_version: "encryptionkey@0"
I20260809 03:25:53.923467 23575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:53.941989 23575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:53.944510 23575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:53.944659 23575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:53.944895 23575 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:25:53.945392 23622 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 03:25:53.946867 23575 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 03:25:53.946930 23575 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 03:25:53.947016 23575 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 03:25:53.947857 23575 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 03:25:53.947906 23575 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 03:25:53.947965 23622 tablet_bootstrap.cc:492] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5: Bootstrap starting.
I20260809 03:25:53.955155 23575 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:37723
I20260809 03:25:53.955591 23575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:25:53.958067 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 23575
I20260809 03:25:53.958367 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:44673
--local_ip_for_outbound_sockets=127.8.5.194
--tserver_master_addrs=127.8.5.254:33341
--webserver_port=41455
--webserver_interface=127.8.5.194
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 03:25:53.959295 23622 log.cc:824] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:53.961826 23622 tablet_bootstrap.cc:492] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 03:25:53.961881 23738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:37723 every 8 connection(s)
I20260809 03:25:53.962154 23622 tablet_bootstrap.cc:492] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5: Bootstrap complete.
I20260809 03:25:53.963531 23622 ts_tablet_manager.cc:1397] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.011s
I20260809 03:25:53.964968 23622 raft_consensus.cc:348] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } }
I20260809 03:25:53.965354 23622 raft_consensus.cc:729] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 648b3e0f3a1444d589cca788758d04d5, State: Initialized, Role: FOLLOWER
I20260809 03:25:53.965528 23622 consensus_queue.cc:260] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } }
I20260809 03:25:53.965804 23622 ts_tablet_manager.cc:1428] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
Aug 09 03:25:53 dist-test-slave-2w3w krb5kdc[22904](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245953, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:25:53.970880 23744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.956430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:39921 (local address 127.8.5.254:33341)
0809 03:25:53.958352 (+ 1922us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:53.958362 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:53.958658 (+ 296us) server_negotiation.cc:407] Connection header received
0809 03:25:53.958821 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:53.958829 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:53.958894 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:53.959062 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:53.960101 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.961508 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.963042 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.963643 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.963750 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.966466 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:53.966472 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:53.966472 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:53.966487 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:53.968821 (+ 2334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:53.969363 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:53.969366 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:53.969366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:53.969482 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:53.969805 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:53.969805 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:53.969806 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:53.970077 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:53.970158 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:53.970537 (+ 379us) server_negotiation.cc:299] Negotiation successful
0809 03:25:53.970674 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1842,"thread_start_us":84,"threads_started":1}
I20260809 03:25:53.971210 23743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.956273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:39921)
0809 03:25:53.956494 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:53.956546 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:53.957123 (+ 577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:53.959220 (+ 2097us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:53.959224 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:53.959693 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:53.959960 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.959967 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.961641 (+ 1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.961642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.962892 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.962895 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.963757 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.963758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.963910 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.964533 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:53.964543 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:53.966335 (+ 1792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:53.968917 (+ 2582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:53.968924 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:53.968927 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:53.969263 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:53.969567 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:53.969568 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:53.969569 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:53.969719 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:53.970157 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:53.970164 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:53.970338 (+ 174us) client_negotiation.cc:769] Sending connection context
0809 03:25:53.970474 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 03:25:53.970760 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":122,"threads_started":1}
I20260809 03:25:53.972031 23739 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33341
I20260809 03:25:53.972131 23739 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:53.972313 23739 heartbeater.cc:511] Master 127.8.5.254:33341 requested a full tablet report, sending...
I20260809 03:25:53.973145 23535 ts_manager.cc:194] Registered new tserver with Master: 648b3e0f3a1444d589cca788758d04d5 (127.8.5.193:37723)
I20260809 03:25:53.974447 23535 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:39921
I20260809 03:25:53.975560 23739 heartbeater.cc:503] Master 127.8.5.254:33341 was elected leader, sending a full tablet report...
I20260809 03:25:53.982503 23750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.975098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57920 (local address 127.8.5.193:37723)
0809 03:25:53.975245 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:53.975250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:53.979191 (+ 3941us) server_negotiation.cc:407] Connection header received
0809 03:25:53.979274 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:53.979276 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:53.979293 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:53.979362 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:25:53.979514 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.980139 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.981627 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.982115 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.982203 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.982242 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:53.982423 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 03:25:53.982453 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":80,"threads_started":1}
I20260809 03:25:53.982522 23748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:53.974915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:37723 (local address 127.0.0.1:57920)
0809 03:25:53.979070 (+ 4155us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:53.979110 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:53.979190 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:53.979387 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:53.979390 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:53.979392 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:25:53.979451 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.979452 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.980208 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.980209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.981509 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:53.981513 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:53.982215 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:53.982216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:53.982302 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:53.982316 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 03:25:53.982395 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 03:25:53.982448 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4122,"thread_start_us":103,"threads_started":1}
I20260809 03:25:53.982918 23668 tablet_service.cc:1514] Processing DeleteTablet for tablet c85df735fd6745c19f43886d735e46c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:25:53 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:57920
I20260809 03:25:53.983533 23751 tablet_replica.cc:330] stopping tablet replica
I20260809 03:25:53.983655 23751 raft_consensus.cc:2229] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:25:53.983777 23751 raft_consensus.cc:2258] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:25:53.984117 23751 ts_tablet_manager.cc:1905] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:25:53.986438 23751 ts_tablet_manager.cc:1918] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:25:53.986522 23751 log.cc:1196] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/wal/wals/c85df735fd6745c19f43886d735e46c2
I20260809 03:25:53.986774 23751 ts_tablet_manager.cc:1939] T c85df735fd6745c19f43886d735e46c2 P 648b3e0f3a1444d589cca788758d04d5: Deleting consensus metadata
I20260809 03:25:53.987294 23520 catalog_manager.cc:4841] TS 648b3e0f3a1444d589cca788758d04d5 (127.8.5.193:37723): tablet c85df735fd6745c19f43886d735e46c2 (table test-table [id=d3aba60698d94798a86fbe9e9617850a]) successfully deleted
W20260809 03:25:54.050760 23746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:54.051018 23746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:54.051062 23746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:54.052203 23746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:54.052264 23746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:54.052309 23746 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:25:54.053735 23746 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:44673
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=41455
--tserver_master_addrs=127.8.5.254:33341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:54.054004 23746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:54.054225 23746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:54.059211 23759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:54.059216 23757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:54.059216 23756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:54.059562 23746 server_base.cc:1034] running on GCE node
I20260809 03:25:54.059763 23746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:54.060040 23746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:54.061215 23746 hybrid_clock.cc:648] HybridClock initialized: now 1786245954061199 us; error 36 us; skew 500 ppm
Aug 09 03:25:54 dist-test-slave-2w3w krb5kdc[22904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245954, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:54.063870 23746 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:25:54.064328 23746 webserver.cc:460] Webserver started at http://127.8.5.194:41455/ using document root <none> and password file <none>
I20260809 03:25:54.064558 23746 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:54.064642 23746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:54.066049 23746 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:25:54.066737 23766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:54.066951 23746 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:25:54.067090 23746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "e69c0534f5d743ad992646c174b03418"
format_stamp: "Formatted at 2026-08-09 03:25:53 on dist-test-slave-2w3w"
server_key: "d9283b231106f930a4a638d3ed6952cb"
server_key_iv: "c0b56f892ae1f0da5d5f0d3eda550e08"
server_key_version: "encryptionkey@0"
I20260809 03:25:54.067430 23746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:54.075290 23746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:54.077450 23746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:54.077605 23746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:54.077833 23746 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:25:54.078135 23746 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:25:54.078188 23746 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:54.078222 23746 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:25:54.078250 23746 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:54.084029 23746 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:44673
I20260809 03:25:54.084064 23891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:44673 every 8 connection(s)
I20260809 03:25:54.084385 23746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:25:54.089429 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 23746
I20260809 03:25:54.089712 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:45773
--local_ip_for_outbound_sockets=127.8.5.195
--tserver_master_addrs=127.8.5.254:33341
--webserver_port=46475
--webserver_interface=127.8.5.195
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 03:25:54 dist-test-slave-2w3w krb5kdc[22904](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245954, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:25:54.094156 23744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.085175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:38645 (local address 127.8.5.254:33341)
0809 03:25:54.085242 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:54.085244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:54.085454 (+ 210us) server_negotiation.cc:407] Connection header received
0809 03:25:54.085934 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:54.085936 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:54.085947 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:54.086021 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:54.086901 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.087482 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.088429 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.088625 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.088681 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:54.090850 (+ 2169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:54.090852 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:54.090852 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:54.090860 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:54.092687 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:54.093214 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:54.093215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:54.093215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:54.093269 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:54.093551 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:54.093552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:54.093552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:54.093654 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:54.093705 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:54.094020 (+ 315us) server_negotiation.cc:299] Negotiation successful
0809 03:25:54.094092 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 03:25:54.094497 23894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.085161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:38645)
0809 03:25:54.085335 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:54.085372 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:54.085807 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:54.086070 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:54.086073 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:54.086608 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:54.086790 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:54.086794 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.087566 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.087567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:54.088352 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:54.088354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.088702 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.088703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:54.088803 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:54.089321 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:54.089329 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:54.090739 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:54.092780 (+ 2041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:54.092787 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:54.092788 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:54.093131 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:54.093331 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:54.093332 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:54.093332 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:54.093484 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:54.093717 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:54.093723 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:54.093887 (+ 164us) client_negotiation.cc:769] Sending connection context
0809 03:25:54.094001 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 03:25:54.094185 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":113,"threads_started":1}
I20260809 03:25:54.095042 23892 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33341
I20260809 03:25:54.095150 23892 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:54.095363 23892 heartbeater.cc:511] Master 127.8.5.254:33341 requested a full tablet report, sending...
I20260809 03:25:54.095785 23535 ts_manager.cc:194] Registered new tserver with Master: e69c0534f5d743ad992646c174b03418 (127.8.5.194:44673)
I20260809 03:25:54.096160 23535 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:38645
W20260809 03:25:54.174216 23896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:54.174403 23896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:54.174425 23896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:54.175649 23896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:54.175693 23896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:54.175748 23896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:25:54.177275 23896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:45773
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=46475
--tserver_master_addrs=127.8.5.254:33341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:54.177500 23896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:54.177736 23896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:54.182945 23902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:54.183092 23896 server_base.cc:1034] running on GCE node
W20260809 03:25:54.183156 23906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:54.183056 23903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:54.183373 23896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:54.183611 23896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:54.184800 23896 hybrid_clock.cc:648] HybridClock initialized: now 1786245954184785 us; error 43 us; skew 500 ppm
Aug 09 03:25:54 dist-test-slave-2w3w krb5kdc[22904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245954, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:54.187279 23896 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:25:54.187734 23896 webserver.cc:460] Webserver started at http://127.8.5.195:46475/ using document root <none> and password file <none>
I20260809 03:25:54.188000 23896 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:54.188084 23896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:54.189350 23896 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260809 03:25:54.190111 23913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:54.190296 23896 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:25:54.190399 23896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "dd0d243d220f4403baeaf4b1af73c1ec"
format_stamp: "Formatted at 2026-08-09 03:25:53 on dist-test-slave-2w3w"
server_key: "c3e44bac1e4f517be62412a8c3b7253b"
server_key_iv: "820291501b916ac84c7d11cd73acbeec"
server_key_version: "encryptionkey@0"
I20260809 03:25:54.190721 23896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:54.211823 23896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:54.214116 23896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:54.214290 23896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:54.214531 23896 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:25:54.214852 23896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:25:54.214907 23896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:54.214942 23896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:25:54.214989 23896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:54.221051 23896 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:45773
I20260809 03:25:54.221084 24036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:45773 every 8 connection(s)
I20260809 03:25:54.221428 23896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:25:54.226259 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 23896
Aug 09 03:25:54 dist-test-slave-2w3w krb5kdc[22904](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245954, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:25:54.231382 23744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.222163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:37881 (local address 127.8.5.254:33341)
0809 03:25:54.222211 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:54.222214 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:54.222403 (+ 189us) server_negotiation.cc:407] Connection header received
0809 03:25:54.222948 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:54.222950 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:54.222987 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:54.223046 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:54.224070 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.224648 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.225626 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.225838 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.225914 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:54.228437 (+ 2523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:54.228438 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:54.228439 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:54.228446 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:54.229954 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:54.230391 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:54.230392 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:54.230393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:54.230452 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:54.230686 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:54.230687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:54.230688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:54.230827 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:54.230905 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:54.231221 (+ 316us) server_negotiation.cc:299] Negotiation successful
0809 03:25:54.231319 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 03:25:54.231647 24040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.222130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:37881)
0809 03:25:54.222274 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:54.222317 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:54.222806 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:54.223143 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:54.223153 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:54.223780 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:54.223969 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:54.223974 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.224735 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.224736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:54.225533 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:54.225535 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.225934 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.225935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:54.226072 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:54.226552 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:54.226563 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:54.228350 (+ 1787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:54.230035 (+ 1685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:54.230041 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:54.230043 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:54.230314 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:54.230523 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:54.230524 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:54.230524 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:54.230618 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:54.230899 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:54.230903 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:54.231061 (+ 158us) client_negotiation.cc:769] Sending connection context
0809 03:25:54.231182 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 03:25:54.231367 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":66,"threads_started":1}
I20260809 03:25:54.232113 24037 heartbeater.cc:347] Connected to a master server at 127.8.5.254:33341
I20260809 03:25:54.232215 24037 heartbeater.cc:464] Registering TS with master...
I20260809 03:25:54.232410 24037 heartbeater.cc:511] Master 127.8.5.254:33341 requested a full tablet report, sending...
I20260809 03:25:54.232841 23535 ts_manager.cc:194] Registered new tserver with Master: dd0d243d220f4403baeaf4b1af73c1ec (127.8.5.195:45773)
I20260809 03:25:54.233317 23535 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:37881
I20260809 03:25:54.234210 24043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.226656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43420 (local address 127.8.5.254:33341)
0809 03:25:54.226811 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:54.226813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:54.226842 (+ 29us) server_negotiation.cc:407] Connection header received
0809 03:25:54.226888 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:54.226888 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:54.226900 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:54.226996 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:54.227557 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.228293 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.229437 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.229627 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.229681 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:54.231140 (+ 1459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:54.231142 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:54.231142 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:54.231148 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:54.233025 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:54.233427 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:54.233428 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:54.233429 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:54.233487 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:54.233703 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:54.233704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:54.233705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:54.233825 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:54.233997 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:54.234037 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 03:25:54.234116 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":77,"threads_started":1}
I20260809 03:25:54.234895 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:25:54.237280 24043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.235258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43422 (local address 127.8.5.254:33341)
0809 03:25:54.235296 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:54.235298 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:54.235416 (+ 118us) server_negotiation.cc:407] Connection header received
0809 03:25:54.235468 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:54.235469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:54.235495 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:54.235550 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:25:54.235635 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.236053 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.236714 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.236891 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.236939 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:54.237055 (+ 116us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:25:54.237133 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:25:54.237182 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:54.237223 (+ 41us) server_negotiation.cc:299] Negotiation successful
0809 03:25:54.237238 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:25:54.237510 23535 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:43422:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:25:54.239082 23535 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:25:54.241403 23668 tablet_service.cc:1467] Processing CreateTablet for tablet b9682add7a764edd90ae485a9191322c (DEFAULT_TABLE table=test-table [id=51bac7b1381742f484125b239977859f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:25:54.241602 23668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9682add7a764edd90ae485a9191322c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:25:54.243251 23622 tablet_bootstrap.cc:492] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5: Bootstrap starting.
I20260809 03:25:54.243548 23622 tablet_bootstrap.cc:654] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5: Neither blocks nor log segments found. Creating new log.
I20260809 03:25:54.244189 23622 tablet_bootstrap.cc:492] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5: No bootstrap required, opened a new log
I20260809 03:25:54.244253 23622 ts_tablet_manager.cc:1397] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 03:25:54.244365 23622 raft_consensus.cc:348] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } }
I20260809 03:25:54.244443 23622 raft_consensus.cc:374] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:25:54.244500 23622 raft_consensus.cc:729] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 648b3e0f3a1444d589cca788758d04d5, State: Initialized, Role: FOLLOWER
I20260809 03:25:54.244546 23622 consensus_queue.cc:260] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } }
I20260809 03:25:54.244655 23622 ts_tablet_manager.cc:1428] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:54.244844 24045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.240989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:45773 (local address 127.0.0.1:43910)
0809 03:25:54.241208 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:54.241219 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:54.241262 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:54.241422 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:54.241423 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:54.241425 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:25:54.241463 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:54.241464 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.242510 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.242511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:54.243622 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:54.243625 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.244606 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.244607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:54.244673 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:54.244677 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:25:54.244729 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 03:25:54.244772 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":84,"threads_started":1}
I20260809 03:25:54.245071 24046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.241053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43910 (local address 127.8.5.195:45773)
0809 03:25:54.241276 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:54.241283 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:54.241297 (+ 14us) server_negotiation.cc:407] Connection header received
0809 03:25:54.241325 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:54.241327 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:54.241339 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:54.241401 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:25:54.241532 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.242425 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.243727 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.244435 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.244510 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:54.244569 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:54.244946 (+ 377us) server_negotiation.cc:299] Negotiation successful
0809 03:25:54.244988 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":74,"threads_started":1}
I20260809 03:25:54.245718 23964 tablet_service.cc:1467] Processing CreateTablet for tablet b9682add7a764edd90ae485a9191322c (DEFAULT_TABLE table=test-table [id=51bac7b1381742f484125b239977859f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:25:54.245976 23964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9682add7a764edd90ae485a9191322c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:25:54.246834 24047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.241069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47192 (local address 127.8.5.194:44673)
0809 03:25:54.243084 (+ 2015us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:54.243087 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:54.243096 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:25:54.243127 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:54.243128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:54.243140 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:54.243227 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:25:54.243398 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.244489 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.245775 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.246446 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.246516 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:54.246568 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:54.246740 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 03:25:54.246772 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1967,"thread_start_us":105,"threads_started":1}
I20260809 03:25:54.246824 23748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.240972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:44673 (local address 127.0.0.1:47192)
0809 03:25:54.241021 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:54.241030 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:54.241066 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:54.243224 (+ 2158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:54.243225 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:54.243227 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:25:54.243264 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:54.243265 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.244613 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.244614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:54.245713 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:54.245716 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.246595 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.246595 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:54.246656 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:54.246659 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:25:54.246725 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 03:25:54.246769 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 03:25:54.247457 23819 tablet_service.cc:1467] Processing CreateTablet for tablet b9682add7a764edd90ae485a9191322c (DEFAULT_TABLE table=test-table [id=51bac7b1381742f484125b239977859f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:25:54.247731 23819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9682add7a764edd90ae485a9191322c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:25:54.248761 24049 tablet_bootstrap.cc:492] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec: Bootstrap starting.
I20260809 03:25:54.249467 24049 tablet_bootstrap.cc:654] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec: Neither blocks nor log segments found. Creating new log.
I20260809 03:25:54.250041 24049 log.cc:824] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:54.250797 24049 tablet_bootstrap.cc:492] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec: No bootstrap required, opened a new log
I20260809 03:25:54.250885 24049 ts_tablet_manager.cc:1397] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:25:54.250880 24051 tablet_bootstrap.cc:492] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418: Bootstrap starting.
I20260809 03:25:54.251420 24051 tablet_bootstrap.cc:654] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418: Neither blocks nor log segments found. Creating new log.
I20260809 03:25:54.251869 24051 log.cc:824] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:54.252383 24049 raft_consensus.cc:348] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } }
I20260809 03:25:54.252511 24049 raft_consensus.cc:374] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:25:54.252542 24051 tablet_bootstrap.cc:492] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418: No bootstrap required, opened a new log
I20260809 03:25:54.252532 24049 raft_consensus.cc:729] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd0d243d220f4403baeaf4b1af73c1ec, State: Initialized, Role: FOLLOWER
I20260809 03:25:54.252610 24051 ts_tablet_manager.cc:1397] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:25:54.252657 24049 consensus_queue.cc:260] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } }
I20260809 03:25:54.252947 24037 heartbeater.cc:503] Master 127.8.5.254:33341 was elected leader, sending a full tablet report...
I20260809 03:25:54.252954 24049 ts_tablet_manager.cc:1428] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 03:25:54.254014 24051 raft_consensus.cc:348] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } }
I20260809 03:25:54.254168 24051 raft_consensus.cc:374] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:25:54.254212 24051 raft_consensus.cc:729] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e69c0534f5d743ad992646c174b03418, State: Initialized, Role: FOLLOWER
I20260809 03:25:54.254318 24051 consensus_queue.cc:260] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } }
I20260809 03:25:54.254554 24051 ts_tablet_manager.cc:1428] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:25:54.254592 23892 heartbeater.cc:503] Master 127.8.5.254:33341 was elected leader, sending a full tablet report...
I20260809 03:25:54.333928 24055 raft_consensus.cc:482] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:25:54.334084 24055 raft_consensus.cc:504] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } }
I20260809 03:25:54.334445 24055 leader_election.cc:288] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd0d243d220f4403baeaf4b1af73c1ec (127.8.5.195:45773), 648b3e0f3a1444d589cca788758d04d5 (127.8.5.193:37723)
W20260809 03:25:54.334939 23893 tablet.cc:2369] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:25:54.338263 24046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.334710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:37277 (local address 127.8.5.195:45773)
0809 03:25:54.334825 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:54.334828 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:54.334838 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:25:54.334868 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:54.334869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:54.334882 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:54.334946 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:25:54.335155 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.335893 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.337326 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.337891 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.337961 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:54.337971 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:54.338153 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 03:25:54.338192 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 03:25:54.338263 23750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.334911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:51567 (local address 127.8.5.193:37723)
0809 03:25:54.335054 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:54.335056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:54.335063 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:25:54.335090 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:54.335091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:54.335104 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:54.335156 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:25:54.335371 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.336040 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.337325 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.337886 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.337961 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:54.337971 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:54.338153 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 03:25:54.338193 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260809 03:25:54.338296 23894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.334630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:45773 (local address 127.8.5.194:37277)
0809 03:25:54.334685 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:54.334699 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:54.334760 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:54.334985 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:54.334986 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:54.334988 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:25:54.335067 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:54.335069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.335995 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.335996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:54.337230 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:54.337232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.337979 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.337980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:54.338066 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:54.338068 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:25:54.338132 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 03:25:54.338188 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":13}
I20260809 03:25:54.338306 24056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.334783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:37723 (local address 127.8.5.194:51567)
0809 03:25:54.334950 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:54.334980 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:54.335028 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:54.335203 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:54.335204 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:54.335206 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:25:54.335279 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:54.335281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.336127 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.336127 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:54.337229 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:54.337232 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.337979 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.337980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:54.338063 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:54.338068 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 03:25:54.338132 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 03:25:54.338188 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":10,"thread_start_us":104,"threads_started":1}
I20260809 03:25:54.338697 23985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9682add7a764edd90ae485a9191322c" candidate_uuid: "e69c0534f5d743ad992646c174b03418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" is_pre_election: true
I20260809 03:25:54.338860 23985 raft_consensus.cc:2454] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e69c0534f5d743ad992646c174b03418 in term 0.
I20260809 03:25:54.338882 23685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9682add7a764edd90ae485a9191322c" candidate_uuid: "e69c0534f5d743ad992646c174b03418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "648b3e0f3a1444d589cca788758d04d5" is_pre_election: true
I20260809 03:25:54.339128 23685 raft_consensus.cc:2454] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e69c0534f5d743ad992646c174b03418 in term 0.
I20260809 03:25:54.339115 23770 leader_election.cc:302] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd0d243d220f4403baeaf4b1af73c1ec, e69c0534f5d743ad992646c174b03418; no voters:
I20260809 03:25:54.339265 24055 raft_consensus.cc:2781] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:25:54.339339 24055 raft_consensus.cc:482] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:25:54.339377 24055 raft_consensus.cc:3037] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:25:54.340142 24055 raft_consensus.cc:504] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } }
I20260809 03:25:54.340291 24055 leader_election.cc:288] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [CANDIDATE]: Term 1 election: Requested vote from peers dd0d243d220f4403baeaf4b1af73c1ec (127.8.5.195:45773), 648b3e0f3a1444d589cca788758d04d5 (127.8.5.193:37723)
I20260809 03:25:54.340476 23985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9682add7a764edd90ae485a9191322c" candidate_uuid: "e69c0534f5d743ad992646c174b03418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd0d243d220f4403baeaf4b1af73c1ec"
I20260809 03:25:54.340508 23685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9682add7a764edd90ae485a9191322c" candidate_uuid: "e69c0534f5d743ad992646c174b03418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "648b3e0f3a1444d589cca788758d04d5"
I20260809 03:25:54.340591 23985 raft_consensus.cc:3037] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:25:54.340586 23685 raft_consensus.cc:3037] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:25:54.341328 23685 raft_consensus.cc:2454] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e69c0534f5d743ad992646c174b03418 in term 1.
I20260809 03:25:54.341414 23985 raft_consensus.cc:2454] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e69c0534f5d743ad992646c174b03418 in term 1.
I20260809 03:25:54.341519 23770 leader_election.cc:302] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 648b3e0f3a1444d589cca788758d04d5, e69c0534f5d743ad992646c174b03418; no voters:
I20260809 03:25:54.341610 24055 raft_consensus.cc:2781] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:25:54.341753 24055 raft_consensus.cc:686] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [term 1 LEADER]: Becoming Leader. State: Replica: e69c0534f5d743ad992646c174b03418, State: Running, Role: LEADER
I20260809 03:25:54.341822 24055 consensus_queue.cc:237] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } }
I20260809 03:25:54.342617 23535 catalog_manager.cc:5495] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 reported cstate change: term changed from 0 to 1, leader changed from <none> to e69c0534f5d743ad992646c174b03418 (127.8.5.194). New cstate: current_term: 1 leader_uuid: "e69c0534f5d743ad992646c174b03418" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } health_report { overall_health: UNKNOWN } } }
I20260809 03:25:54.359956 24047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.357526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47202 (local address 127.8.5.194:44673)
0809 03:25:54.357589 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:54.357591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:54.357600 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:25:54.357656 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:54.357657 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:54.357683 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:54.357759 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:25:54.357889 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.358356 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.359144 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:54.359345 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:54.359424 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:54.359600 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:25:54.359691 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:25:54.359773 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:54.359829 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 03:25:54.359848 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 03:25:54.361696 23985 raft_consensus.cc:1261] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec [term 1 FOLLOWER]: Refusing update from remote peer e69c0534f5d743ad992646c174b03418: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:25:54.361764 23685 raft_consensus.cc:1261] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Refusing update from remote peer e69c0534f5d743ad992646c174b03418: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:25:54.362035 24057 consensus_queue.cc:1035] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:25:54.362221 24055 consensus_queue.cc:1035] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:25:54.364863 24061 mvcc.cc:205] Tried to move back new op lower bound from 7316463429062688768 to 7316463428984664064. Current Snapshot: MvccSnapshot[applied={T|T < 7316463429062688768}]
I20260809 03:25:54.367267 23534 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:43422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:25:54.367362 23534 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:43422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:25:54.368129 23534 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0: Sending DeleteTablet for 3 replicas of tablet b9682add7a764edd90ae485a9191322c
I20260809 03:25:54.368527 23668 tablet_service.cc:1514] Processing DeleteTablet for tablet b9682add7a764edd90ae485a9191322c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:25:54 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:57920
I20260809 03:25:54.368520 23964 tablet_service.cc:1514] Processing DeleteTablet for tablet b9682add7a764edd90ae485a9191322c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:25:54 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:43910
I20260809 03:25:54.368618 23751 tablet_replica.cc:330] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5: stopping tablet replica
I20260809 03:25:54.368664 23751 raft_consensus.cc:2229] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:25:54.368702 23751 raft_consensus.cc:2258] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:25:54.368741 24070 tablet_replica.cc:330] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec: stopping tablet replica
I20260809 03:25:54.368762 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 23575
I20260809 03:25:54.368834 24070 raft_consensus.cc:2229] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:25:54.368944 24070 raft_consensus.cc:2258] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:25:54.370206 24070 ts_tablet_manager.cc:1905] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:25:54.372287 24070 ts_tablet_manager.cc:1918] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:25:54.372363 24070 log.cc:1196] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/b9682add7a764edd90ae485a9191322c
I20260809 03:25:54.372400 23819 tablet_service.cc:1514] Processing DeleteTablet for tablet b9682add7a764edd90ae485a9191322c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:25:54 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:47192
I20260809 03:25:54.372648 24070 ts_tablet_manager.cc:1939] T b9682add7a764edd90ae485a9191322c P dd0d243d220f4403baeaf4b1af73c1ec: Deleting consensus metadata
I20260809 03:25:54.372745 24071 tablet_replica.cc:330] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418: stopping tablet replica
I20260809 03:25:54.372922 24071 raft_consensus.cc:2229] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:25:54.373095 24071 raft_consensus.cc:2258] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:25:54.373755 24071 ts_tablet_manager.cc:1905] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:25:54.373764 23520 catalog_manager.cc:4841] TS dd0d243d220f4403baeaf4b1af73c1ec (127.8.5.195:45773): tablet b9682add7a764edd90ae485a9191322c (table test-table [id=51bac7b1381742f484125b239977859f]) successfully deleted
I20260809 03:25:54.375437 24071 ts_tablet_manager.cc:1918] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:25:54.375567 24071 log.cc:1196] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/b9682add7a764edd90ae485a9191322c
I20260809 03:25:54.375928 24071 ts_tablet_manager.cc:1939] T b9682add7a764edd90ae485a9191322c P e69c0534f5d743ad992646c174b03418: Deleting consensus metadata
I20260809 03:25:54.376379 23519 catalog_manager.cc:4841] TS e69c0534f5d743ad992646c174b03418 (127.8.5.194:44673): tablet b9682add7a764edd90ae485a9191322c (table test-table [id=51bac7b1381742f484125b239977859f]) successfully deleted
W20260809 03:25:54.377791 23520 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.5.193:37723 (error 108)
I20260809 03:25:54.378243 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 23746
I20260809 03:25:54.378350 23748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.378211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:37723 (local address 127.0.0.1:57932)
0809 03:25:54.378258 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:54.378303 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.193:37723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260809 03:25:54.378453 23520 catalog_manager.cc:4584] TS 648b3e0f3a1444d589cca788758d04d5 (127.8.5.193:37723): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b9682add7a764edd90ae485a9191322c: Network error: Client connection negotiation failed: client connection to 127.8.5.193:37723: connect: Connection refused (error 111)
I20260809 03:25:54.384882 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 23896
I20260809 03:25:54.390185 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 23498
I20260809 03:25:54.397584 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:33341
--webserver_interface=127.8.5.254
--webserver_port=35393
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:33341
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:25:54.478451 24073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:54.478643 24073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:54.478664 24073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:54.479817 24073 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:25:54.479856 24073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:54.479869 24073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:54.479930 24073 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:25:54.479955 24073 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:25:54.481330 24073 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:33341
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:33341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=35393
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:54.481564 24073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:54.481812 24073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:54.486519 24079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:54.486598 24081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:54.486651 24073 server_base.cc:1034] running on GCE node
W20260809 03:25:54.486541 24078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:54.486992 24073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:54.487319 24073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:54.488476 24073 hybrid_clock.cc:648] HybridClock initialized: now 1786245954488465 us; error 23 us; skew 500 ppm
Aug 09 03:25:54 dist-test-slave-2w3w krb5kdc[22904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245954, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:54.490885 24073 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:25:54.491367 24073 webserver.cc:460] Webserver started at http://127.8.5.254:35393/ using document root <none> and password file <none>
I20260809 03:25:54.491602 24073 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:54.491671 24073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:54.492947 24073 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:25:54.493619 24088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:54.493798 24073 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:25:54.493897 24073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "d3f497a84fc042bea35cdbaec75e0be0"
format_stamp: "Formatted at 2026-08-09 03:25:52 on dist-test-slave-2w3w"
server_key: "568c96672da935004e594c6e39abce81"
server_key_iv: "4157e892d2afa81f5702fc9a2bc5c119"
server_key_version: "encryptionkey@0"
I20260809 03:25:54.494217 24073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:54.528955 24073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:54.531384 24073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:54.531548 24073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:54.535843 24073 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:33341
I20260809 03:25:54.535883 24147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:33341 every 8 connection(s)
I20260809 03:25:54.536265 24073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:25:54.537811 24148 sys_catalog.cc:263] Verifying existing consensus state
I20260809 03:25:54.538482 24148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0: Bootstrap starting.
I20260809 03:25:54.543011 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 24073
I20260809 03:25:54.543339 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:37723
--local_ip_for_outbound_sockets=127.8.5.193
--tserver_master_addrs=127.8.5.254:33341
--webserver_port=32947
--webserver_interface=127.8.5.193
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 03:25:54.548219 24148 log.cc:824] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:54.550395 24148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 03:25:54.550701 24148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0: Bootstrap complete.
I20260809 03:25:54.553068 24148 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3f497a84fc042bea35cdbaec75e0be0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33341 } }
I20260809 03:25:54.553289 24148 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3f497a84fc042bea35cdbaec75e0be0, State: Initialized, Role: FOLLOWER
I20260809 03:25:54.553464 24148 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3f497a84fc042bea35cdbaec75e0be0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33341 } }
I20260809 03:25:54.553550 24148 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:25:54.553604 24148 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:25:54.553679 24148 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 2 FOLLOWER]: Advancing to term 3
I20260809 03:25:54.554689 24148 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3f497a84fc042bea35cdbaec75e0be0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33341 } }
I20260809 03:25:54.554842 24148 leader_election.cc:302] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3f497a84fc042bea35cdbaec75e0be0; no voters:
I20260809 03:25:54.555063 24148 leader_election.cc:288] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 03:25:54.555100 24153 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 03:25:54.555213 24153 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [term 3 LEADER]: Becoming Leader. State: Replica: d3f497a84fc042bea35cdbaec75e0be0, State: Running, Role: LEADER
I20260809 03:25:54.555308 24153 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3f497a84fc042bea35cdbaec75e0be0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33341 } }
I20260809 03:25:54.555354 24148 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:25:54.555575 24155 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3f497a84fc042bea35cdbaec75e0be0. Latest consensus state: current_term: 3 leader_uuid: "d3f497a84fc042bea35cdbaec75e0be0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3f497a84fc042bea35cdbaec75e0be0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33341 } } }
I20260809 03:25:54.555781 24155 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [sys.catalog]: This master's current role is: LEADER
I20260809 03:25:54.555727 24154 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "d3f497a84fc042bea35cdbaec75e0be0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3f497a84fc042bea35cdbaec75e0be0" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33341 } } }
I20260809 03:25:54.556027 24154 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3f497a84fc042bea35cdbaec75e0be0 [sys.catalog]: This master's current role is: LEADER
I20260809 03:25:54.556165 24162 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:25:54.556913 24162 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:25:54.557011 24162 catalog_manager.cc:1259] Loaded cluster ID: c25be0721ede4c0b855c5b0518464e3a
I20260809 03:25:54.557041 24162 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 03:25:54.557273 24162 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f82934a99ad google::LogMessage::Fail() at ??:0
@ 0x7f82934ac88a google::LogMessage::SendToLog() at ??:0
@ 0x7f82934a94de google::LogMessage::Flush() at ??:0
@ 0x7f82934aaa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f829b3ca0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f829b3d38b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f82953770d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f829536c954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f82961d06db start_thread at ??:0
@ 0x7f8291fa761f clone at ??:0
W20260809 03:25:54.638617 24151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:54.638870 24151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:54.638907 24151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:54.640082 24151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:54.640167 24151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:54.640213 24151 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:25:54.641674 24151 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:37723
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=32947
--tserver_master_addrs=127.8.5.254:33341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:54.641968 24151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:54.642194 24151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:54.647125 24188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:54.647092 24187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:54.647099 24192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:54.647420 24151 server_base.cc:1034] running on GCE node
I20260809 03:25:54.647686 24151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:54.647941 24151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:54.649117 24151 hybrid_clock.cc:648] HybridClock initialized: now 1786245954649092 us; error 43 us; skew 500 ppm
Aug 09 03:25:54 dist-test-slave-2w3w krb5kdc[22904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245954, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:54.651791 24151 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:25:54.652261 24151 webserver.cc:460] Webserver started at http://127.8.5.193:32947/ using document root <none> and password file <none>
I20260809 03:25:54.652483 24151 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:54.652551 24151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:54.653960 24151 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:25:54.654770 24199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:54.655000 24151 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:25:54.655109 24151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "648b3e0f3a1444d589cca788758d04d5"
format_stamp: "Formatted at 2026-08-09 03:25:53 on dist-test-slave-2w3w"
server_key: "e014afba800953ad837b3358b6c7c015"
server_key_iv: "9a82ff378914feafd3422c72bd99ec80"
server_key_version: "encryptionkey@0"
I20260809 03:25:54.655472 24151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:54.665903 24151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:54.668229 24151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:54.668404 24151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:54.668637 24151 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:25:54.669090 24207 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 03:25:54.671010 24151 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 03:25:54.671080 24151 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 03:25:54.671115 24151 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 03:25:54.671734 24151 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 03:25:54.671799 24151 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 03:25:54.671868 24207 tablet_bootstrap.cc:492] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5: Bootstrap starting.
I20260809 03:25:54.673710 24207 log.cc:824] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5: Log is configured to *not* fsync() on all Append() calls
I20260809 03:25:54.676795 24207 tablet_bootstrap.cc:492] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 03:25:54.677127 24207 tablet_bootstrap.cc:492] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5: Bootstrap complete.
I20260809 03:25:54.677297 24207 ts_tablet_manager.cc:1397] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.001s
I20260809 03:25:54.679282 24151 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:37723
I20260809 03:25:54.679390 24322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:37723 every 8 connection(s)
I20260809 03:25:54.679216 24207 raft_consensus.cc:348] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } }
I20260809 03:25:54.679613 24207 raft_consensus.cc:729] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 648b3e0f3a1444d589cca788758d04d5, State: Initialized, Role: FOLLOWER
I20260809 03:25:54.679697 24151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:25:54.679811 24207 consensus_queue.cc:260] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } }
I20260809 03:25:54.680198 24207 ts_tablet_manager.cc:1428] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5: Time spent starting tablet: real 0.003s user 0.001s sys 0.004s
I20260809 03:25:54.689468 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 24151
I20260809 03:25:54.689838 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:44673
--local_ip_for_outbound_sockets=127.8.5.194
--tserver_master_addrs=127.8.5.254:33341
--webserver_port=41455
--webserver_interface=127.8.5.194
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:25:54.750012 24328 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:25:54.680493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:35561)
0809 03:25:54.680663 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:54.680702 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:54.680834 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:54.749801 (+ 68967us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":80,"threads_started":1}
W20260809 03:25:54.750294 24324 heartbeater.cc:644] Failed to heartbeat to 127.8.5.254:33341 (0 consecutive failures): Network error: Failed to ping master at 127.8.5.254:33341: Client connection negotiation failed: client connection to 127.8.5.254:33341: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 03:25:54.750664 24328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.750532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:47539)
0809 03:25:54.750590 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:54.750638 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 03:25:54.751029 24328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.750926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:53089)
0809 03:25:54.750954 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:54.751007 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260809 03:25:54.751154 24324 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 03:25:54.773557 24329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:54.773736 24329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:54.773758 24329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:54.774923 24329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:54.775004 24329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:54.775063 24329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:25:54.776513 24329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:44673
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=41455
--tserver_master_addrs=127.8.5.254:33341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24329
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:54.776753 24329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:54.777029 24329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:25:54.781810 24334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:54.781802 24335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:54.781788 24338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:54.781837 24329 server_base.cc:1034] running on GCE node
I20260809 03:25:54.782204 24329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:54.782459 24329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:54.783602 24329 hybrid_clock.cc:648] HybridClock initialized: now 1786245954783579 us; error 37 us; skew 500 ppm
Aug 09 03:25:54 dist-test-slave-2w3w krb5kdc[22904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245954, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:54.786010 24329 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:25:54.786515 24329 webserver.cc:460] Webserver started at http://127.8.5.194:41455/ using document root <none> and password file <none>
I20260809 03:25:54.786754 24329 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:54.786804 24329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:54.788152 24329 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:25:54.788722 24346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:54.788892 24329 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:25:54.788969 24329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "e69c0534f5d743ad992646c174b03418"
format_stamp: "Formatted at 2026-08-09 03:25:53 on dist-test-slave-2w3w"
server_key: "d9283b231106f930a4a638d3ed6952cb"
server_key_iv: "c0b56f892ae1f0da5d5f0d3eda550e08"
server_key_version: "encryptionkey@0"
I20260809 03:25:54.789269 24329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:54.803753 24329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:54.805629 24329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:54.805739 24329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:54.805933 24329 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:25:54.806244 24329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:25:54.806277 24329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:54.806324 24329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:25:54.806351 24329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:54.812259 24329 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:44673
I20260809 03:25:54.812338 24467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:44673 every 8 connection(s)
I20260809 03:25:54.812711 24329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:25:54.813760 24470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.813395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:59101)
0809 03:25:54.813539 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:54.813612 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":69,"threads_started":1}
W20260809 03:25:54.814158 24468 heartbeater.cc:644] Failed to heartbeat to 127.8.5.254:33341 (0 consecutive failures): Network error: Failed to ping master at 127.8.5.254:33341: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
I20260809 03:25:54.814445 24470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.814357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:42481)
0809 03:25:54.814402 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:54.814428 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 03:25:54.814692 24470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.814646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:49231)
0809 03:25:54.814664 (+ 18us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:54.814681 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260809 03:25:54.814823 24468 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 03:25:54.817003 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 24329
I20260809 03:25:54.817281 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:45773
--local_ip_for_outbound_sockets=127.8.5.195
--tserver_master_addrs=127.8.5.254:33341
--webserver_port=46475
--webserver_interface=127.8.5.195
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:25:54.900110 24471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:25:54.900307 24471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:25:54.900328 24471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:25:54.901513 24471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:25:54.901557 24471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:25:54.901583 24471 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:25:54.903162 24471 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:45773
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=46475
--tserver_master_addrs=127.8.5.254:33341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:25:54.903409 24471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:25:54.903653 24471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 03:25:54.908891 24471 server_base.cc:1034] running on GCE node
W20260809 03:25:54.908856 24480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:54.908874 24477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:25:54.908875 24478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:25:54.909243 24471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:25:54.909518 24471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:25:54.910696 24471 hybrid_clock.cc:648] HybridClock initialized: now 1786245954910685 us; error 29 us; skew 500 ppm
Aug 09 03:25:54 dist-test-slave-2w3w krb5kdc[22904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245954, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:25:54.913332 24471 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:25:54.913800 24471 webserver.cc:460] Webserver started at http://127.8.5.195:46475/ using document root <none> and password file <none>
I20260809 03:25:54.914048 24471 fs_manager.cc:359] Metadata directory not provided
I20260809 03:25:54.914119 24471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:25:54.915555 24471 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:25:54.916167 24487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:54.916356 24471 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:25:54.916455 24471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "dd0d243d220f4403baeaf4b1af73c1ec"
format_stamp: "Formatted at 2026-08-09 03:25:53 on dist-test-slave-2w3w"
server_key: "c3e44bac1e4f517be62412a8c3b7253b"
server_key_iv: "820291501b916ac84c7d11cd73acbeec"
server_key_version: "encryptionkey@0"
I20260809 03:25:54.916800 24471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:25:54.939096 24471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:25:54.941076 24471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:25:54.941252 24471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:25:54.941506 24471 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:25:54.941830 24471 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:25:54.941884 24471 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:54.941921 24471 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:25:54.941972 24471 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:25:54.947784 24471 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:45773
I20260809 03:25:54.947837 24610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:45773 every 8 connection(s)
I20260809 03:25:54.948161 24471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:25:54.949214 24613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.948820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:55265)
0809 03:25:54.948995 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:54.949074 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":75,"threads_started":1}
W20260809 03:25:54.949637 24611 heartbeater.cc:644] Failed to heartbeat to 127.8.5.254:33341 (0 consecutive failures): Network error: Failed to ping master at 127.8.5.254:33341: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
I20260809 03:25:54.949931 24613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.949836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:33259)
0809 03:25:54.949879 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:54.949914 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 03:25:54.950182 24613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:54.950134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:39761)
0809 03:25:54.950153 (+ 19us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:54.950171 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260809 03:25:54.950331 24611 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 03:25:54.953245 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 24471
I20260809 03:25:55.751742 24617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:55.751509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:57411)
0809 03:25:55.751655 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:55.751690 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":64,"threads_started":1}
I20260809 03:25:55.815470 24619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:55.815206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:41771)
0809 03:25:55.815380 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:55.815416 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":121,"threads_started":1}
I20260809 03:25:55.950910 24620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:55.950688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:57497)
0809 03:25:55.950811 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:55.950855 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":59,"threads_started":1}
I20260809 03:25:56.203742 24621 raft_consensus.cc:482] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:25:56.203915 24621 raft_consensus.cc:504] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } }
I20260809 03:25:56.204308 24621 leader_election.cc:288] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e69c0534f5d743ad992646c174b03418 (127.8.5.194:44673), dd0d243d220f4403baeaf4b1af73c1ec (127.8.5.195:45773)
Aug 09 03:25:56 dist-test-slave-2w3w krb5kdc[22904](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245954, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.194@KRBTEST.COM
Aug 09 03:25:56 dist-test-slave-2w3w krb5kdc[22904](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245954, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.195@KRBTEST.COM
I20260809 03:25:56.214694 24623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:56.204617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:54363 (local address 127.8.5.194:44673)
0809 03:25:56.204783 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:56.204796 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:56.204830 (+ 34us) server_negotiation.cc:407] Connection header received
0809 03:25:56.205330 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:56.205332 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:56.205383 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:56.205539 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:56.206288 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:56.207207 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:56.208266 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:56.208686 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:56.208820 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:56.211037 (+ 2217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:56.211041 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:56.211041 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:56.211054 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:56.213001 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:56.213417 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:56.213421 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:56.213421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:56.213514 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:56.213773 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:56.213774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:56.213774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:56.214101 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:56.214178 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:56.214464 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 03:25:56.214588 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":65,"threads_started":1}
I20260809 03:25:56.214679 24617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:56.204515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:44673 (local address 127.8.5.193:54363)
0809 03:25:56.204570 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:56.204581 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:56.204638 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:56.205565 (+ 927us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:56.205567 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:56.205941 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:56.206149 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:56.206155 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:56.207307 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:56.207308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:56.208167 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:56.208169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:56.208783 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:56.208784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:56.208924 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:56.209435 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:56.209444 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:56.210903 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:56.213099 (+ 2196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:56.213106 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:56.213108 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:56.213328 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:56.213596 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:56.213597 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:56.213597 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:56.213703 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:56.214156 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:56.214163 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:56.214294 (+ 131us) client_negotiation.cc:769] Sending connection context
0809 03:25:56.214400 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 03:25:56.214562 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 03:25:56.214864 24622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:56.204602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:45773 (local address 127.8.5.193:57551)
0809 03:25:56.204737 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:56.204749 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:25:56.204804 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:25:56.205637 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:25:56.205638 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:25:56.206229 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:25:56.206293 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:56.206296 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:56.207543 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:56.207544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:56.208213 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:25:56.208216 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:25:56.208882 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:25:56.208883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:25:56.208952 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:56.209605 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:25:56.209611 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:25:56.211464 (+ 1853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:25:56.213559 (+ 2095us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:56.213560 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:56.213560 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:56.213751 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:56.213970 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:25:56.213971 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:25:56.213971 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:25:56.214031 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:25:56.214418 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:25:56.214419 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:25:56.214469 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 03:25:56.214572 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 03:25:56.214680 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":74,"threads_started":1}
I20260809 03:25:56.214920 24624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:56.204793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:57551 (local address 127.8.5.195:45773)
0809 03:25:56.204954 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 03:25:56.204965 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 03:25:56.205007 (+ 42us) server_negotiation.cc:407] Connection header received
0809 03:25:56.205448 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:25:56.205450 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:25:56.205489 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:25:56.205649 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:25:56.206448 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:56.207444 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:56.208320 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:25:56.208757 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:25:56.208906 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:25:56.211568 (+ 2662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:25:56.211572 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:25:56.211572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:25:56.211586 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:25:56.213479 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:56.213827 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:56.213829 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:56.213829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:56.213905 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:25:56.214099 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:25:56.214099 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:25:56.214100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:25:56.214310 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:25:56.214437 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 03:25:56.214639 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 03:25:56.214800 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":61,"threads_started":1}
W20260809 03:25:56.215794 24204 leader_election.cc:341] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dd0d243d220f4403baeaf4b1af73c1ec (127.8.5.195:45773): Not found: Tablet not found: b9682add7a764edd90ae485a9191322c
W20260809 03:25:56.216187 24203 leader_election.cc:341] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e69c0534f5d743ad992646c174b03418 (127.8.5.194:44673): Not found: Tablet not found: b9682add7a764edd90ae485a9191322c
I20260809 03:25:56.216238 24203 leader_election.cc:302] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 648b3e0f3a1444d589cca788758d04d5; no voters: dd0d243d220f4403baeaf4b1af73c1ec, e69c0534f5d743ad992646c174b03418
I20260809 03:25:56.216341 24621 raft_consensus.cc:2726] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 03:25:56.752528 24625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:56.752253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:41811)
0809 03:25:56.752410 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:56.752462 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":131,"threads_started":1}
I20260809 03:25:56.816218 24626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:56.816007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:44715)
0809 03:25:56.816141 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:56.816178 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":60,"threads_started":1}
I20260809 03:25:56.951614 24627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:56.951421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:49889)
0809 03:25:56.951536 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:56.951573 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":58,"threads_started":1}
I20260809 03:25:57.753173 24628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:57.752970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:51865)
0809 03:25:57.753091 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:57.753125 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":61,"threads_started":1}
I20260809 03:25:57.816890 24629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:57.816688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:34341)
0809 03:25:57.816802 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:57.816836 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":64,"threads_started":1}
I20260809 03:25:57.952258 24630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:57.952050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:34335)
0809 03:25:57.952183 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:57.952219 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":61,"threads_started":1}
I20260809 03:25:58.187644 24631 raft_consensus.cc:482] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:25:58.187733 24631 raft_consensus.cc:504] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } }
I20260809 03:25:58.187901 24631 leader_election.cc:288] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e69c0534f5d743ad992646c174b03418 (127.8.5.194:44673), dd0d243d220f4403baeaf4b1af73c1ec (127.8.5.195:45773)
W20260809 03:25:58.188338 24203 leader_election.cc:341] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e69c0534f5d743ad992646c174b03418 (127.8.5.194:44673): Not found: Tablet not found: b9682add7a764edd90ae485a9191322c
W20260809 03:25:58.188432 24204 leader_election.cc:341] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dd0d243d220f4403baeaf4b1af73c1ec (127.8.5.195:45773): Not found: Tablet not found: b9682add7a764edd90ae485a9191322c
I20260809 03:25:58.188571 24203 leader_election.cc:302] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 648b3e0f3a1444d589cca788758d04d5; no voters: dd0d243d220f4403baeaf4b1af73c1ec, e69c0534f5d743ad992646c174b03418
I20260809 03:25:58.188656 24631 raft_consensus.cc:2726] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 03:25:58.753966 24632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:58.753742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:34709)
0809 03:25:58.753879 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:58.753917 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":82,"threads_started":1}
I20260809 03:25:58.817559 24633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:58.817343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:54929)
0809 03:25:58.817482 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:58.817520 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":60,"threads_started":1}
I20260809 03:25:58.952972 24634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:58.952729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:48633)
0809 03:25:58.952889 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:58.952930 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":106,"threads_started":1}
I20260809 03:25:59.754755 24636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:59.754521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:46845)
0809 03:25:59.754663 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:59.754696 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
I20260809 03:25:59.818287 24637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:59.818094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:48693)
0809 03:25:59.818210 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:59.818242 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":61,"threads_started":1}
I20260809 03:25:59.953635 24638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:25:59.953434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:51811)
0809 03:25:59.953562 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 03:25:59.953594 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":63,"threads_started":1}
I20260809 03:26:00.755558 24639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:00.755320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:39689)
0809 03:26:00.755465 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:00.755505 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":70,"threads_started":1}
I20260809 03:26:00.818991 24640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:00.818733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:39663)
0809 03:26:00.818872 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:00.818911 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":62,"threads_started":1}
I20260809 03:26:00.954319 24641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:00.954109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:52251)
0809 03:26:00.954233 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:00.954269 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
I20260809 03:26:01.153769 24642 raft_consensus.cc:482] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:26:01.153869 24642 raft_consensus.cc:504] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } }
I20260809 03:26:01.154019 24642 leader_election.cc:288] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e69c0534f5d743ad992646c174b03418 (127.8.5.194:44673), dd0d243d220f4403baeaf4b1af73c1ec (127.8.5.195:45773)
W20260809 03:26:01.154429 24204 leader_election.cc:341] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dd0d243d220f4403baeaf4b1af73c1ec (127.8.5.195:45773): Not found: Tablet not found: b9682add7a764edd90ae485a9191322c
W20260809 03:26:01.154513 24203 leader_election.cc:341] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e69c0534f5d743ad992646c174b03418 (127.8.5.194:44673): Not found: Tablet not found: b9682add7a764edd90ae485a9191322c
I20260809 03:26:01.154592 24203 leader_election.cc:302] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 648b3e0f3a1444d589cca788758d04d5; no voters: dd0d243d220f4403baeaf4b1af73c1ec, e69c0534f5d743ad992646c174b03418
I20260809 03:26:01.154691 24642 raft_consensus.cc:2726] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 03:26:01.756358 24643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:01.756142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:41865)
0809 03:26:01.756268 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:01.756304 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":67,"threads_started":1}
I20260809 03:26:01.819693 24644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:01.819476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:50989)
0809 03:26:01.819605 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:01.819649 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":62,"threads_started":1}
I20260809 03:26:01.955258 24645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:01.954878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:51549)
0809 03:26:01.955141 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:01.955197 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":146,"threads_started":1}
I20260809 03:26:02.757227 24646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:02.756987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:40269)
0809 03:26:02.757128 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:02.757178 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":69,"threads_started":1}
I20260809 03:26:02.820547 24648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:02.820300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:56895)
0809 03:26:02.820424 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:02.820463 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":64,"threads_started":1}
I20260809 03:26:02.955891 24649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:02.955704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:45383)
0809 03:26:02.955817 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:02.955847 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":57,"threads_started":1}
I20260809 03:26:03.758034 24650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:03.757812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:42593)
0809 03:26:03.757949 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:03.757988 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":70,"threads_started":1}
I20260809 03:26:03.821278 24651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:03.821057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:60557)
0809 03:26:03.821197 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:03.821234 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":81,"threads_started":1}
I20260809 03:26:03.956602 24652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:03.956387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:42301)
0809 03:26:03.956522 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:03.956559 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":61,"threads_started":1}
I20260809 03:26:04.738458 24653 raft_consensus.cc:482] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:26:04.738557 24653 raft_consensus.cc:504] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e69c0534f5d743ad992646c174b03418" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 44673 } } peers { permanent_uuid: "dd0d243d220f4403baeaf4b1af73c1ec" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45773 } } peers { permanent_uuid: "648b3e0f3a1444d589cca788758d04d5" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37723 } }
I20260809 03:26:04.738716 24653 leader_election.cc:288] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e69c0534f5d743ad992646c174b03418 (127.8.5.194:44673), dd0d243d220f4403baeaf4b1af73c1ec (127.8.5.195:45773)
W20260809 03:26:04.739159 24203 leader_election.cc:341] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e69c0534f5d743ad992646c174b03418 (127.8.5.194:44673): Not found: Tablet not found: b9682add7a764edd90ae485a9191322c
W20260809 03:26:04.739233 24204 leader_election.cc:341] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dd0d243d220f4403baeaf4b1af73c1ec (127.8.5.195:45773): Not found: Tablet not found: b9682add7a764edd90ae485a9191322c
I20260809 03:26:04.739264 24203 leader_election.cc:302] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 648b3e0f3a1444d589cca788758d04d5; no voters: dd0d243d220f4403baeaf4b1af73c1ec, e69c0534f5d743ad992646c174b03418
I20260809 03:26:04.739358 24653 raft_consensus.cc:2726] T b9682add7a764edd90ae485a9191322c P 648b3e0f3a1444d589cca788758d04d5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 03:26:04.758805 24655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:04.758535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:57863)
0809 03:26:04.758718 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:04.758757 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":65,"threads_started":1}
I20260809 03:26:04.822090 24656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:04.821778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:40299)
0809 03:26:04.821961 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:04.822009 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":93,"threads_started":1}
I20260809 03:26:04.957382 24657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:04.957108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:33897)
0809 03:26:04.957248 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:04.957316 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":63,"threads_started":1}
I20260809 03:26:05.759550 24659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:05.759322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:38527)
0809 03:26:05.759454 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:05.759499 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":69,"threads_started":1}
I20260809 03:26:05.822856 24660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:05.822595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:43687)
0809 03:26:05.822762 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:05.822805 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":85,"threads_started":1}
I20260809 03:26:05.958057 24662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:05.957856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:48735)
0809 03:26:05.957976 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:05.958010 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":64,"threads_started":1}
I20260809 03:26:06.760241 24663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:06.760028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:52483)
0809 03:26:06.760157 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:06.760192 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":68,"threads_started":1}
I20260809 03:26:06.823562 24664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:06.823365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:39257)
0809 03:26:06.823483 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:06.823518 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":61,"threads_started":1}
I20260809 03:26:06.958828 24665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:06.958463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:38271)
0809 03:26:06.958674 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:06.958716 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":78,"threads_started":1}
I20260809 03:26:07.760977 24666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:07.760722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:43063)
0809 03:26:07.760893 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:07.760929 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":103,"threads_started":1}
I20260809 03:26:07.824352 24667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:07.824141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:40535)
0809 03:26:07.824261 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:07.824305 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":61,"threads_started":1}
I20260809 03:26:07.959533 24669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:07.959307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:45407)
0809 03:26:07.959448 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:07.959487 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":81,"threads_started":1}
I20260809 03:26:08.761693 24670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:08.761469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:51315)
0809 03:26:08.761607 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:08.761645 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":83,"threads_started":1}
I20260809 03:26:08.824986 24671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:08.824773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:38835)
0809 03:26:08.824904 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:08.824941 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":60,"threads_started":1}
I20260809 03:26:08.960232 24672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:08.960026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:52727)
0809 03:26:08.960150 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:08.960187 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":65,"threads_started":1}
I20260809 03:26:09.762485 24673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:09.762272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.193:41363)
0809 03:26:09.762401 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:09.762437 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":65,"threads_started":1}
I20260809 03:26:09.825766 24674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:09.825535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.194:33499)
0809 03:26:09.825682 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:09.825721 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":61,"threads_started":1}
I20260809 03:26:09.960965 24675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:09.960733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:33341 (local address 127.8.5.195:53523)
0809 03:26:09.960881 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:09.960918 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:33341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":63,"threads_started":1}
I20260809 03:26:09.963495 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 24151
I20260809 03:26:09.970506 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 24329
I20260809 03:26:09.976522 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 24471
2026-08-09T03:26:09Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18279 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:26:10 dist-test-slave-2w3w krb5kdc[24679](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:26:10 dist-test-slave-2w3w krb5kdc[24679](info): set up 2 sockets
Aug 09 03:26:10 dist-test-slave-2w3w krb5kdc[24679](info): commencing operation
krb5kdc: starting...
W20260809 03:26:11.068528 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:26:11 dist-test-slave-2w3w krb5kdc[24679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245971, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:26:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:26:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:26:11.190030 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:38695
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:38695
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:26:11.270782 24693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:26:11.270987 24693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:26:11.271008 24693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:26:11.272148 24693 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 03:26:11.272186 24693 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 03:26:11.272199 24693 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 03:26:11.272210 24693 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:26:11.272256 24693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:26:11.272274 24693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:26:11.272297 24693 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:26:11.272321 24693 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:26:11.273731 24693 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:38695
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:38695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:26:11.273972 24693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:26:11.274191 24693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:26:11.279275 24702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:26:11.279227 24698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:26:11.279256 24700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:26:11.279256 24693 server_base.cc:1034] running on GCE node
I20260809 03:26:11.279698 24693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:26:11.279995 24693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:26:11.281157 24693 hybrid_clock.cc:648] HybridClock initialized: now 1786245971281130 us; error 48 us; skew 500 ppm
Aug 09 03:26:11 dist-test-slave-2w3w krb5kdc[24679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245971, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:26:11.283669 24693 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:26:11.284137 24693 webserver.cc:460] Webserver started at http://127.8.5.254:40011/ using document root <none> and password file <none>
I20260809 03:26:11.284371 24693 fs_manager.cc:359] Metadata directory not provided
I20260809 03:26:11.284439 24693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:26:11.284597 24693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:26:11.285626 24693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "8a6fcf503d04472b8510635ce8d94c52"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "08820c93fc936668b389a94c267f2082"
server_key_iv: "94503ce873be750228b4647c1f854040"
server_key_version: "encryptionkey@0"
I20260809 03:26:11.286012 24693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "8a6fcf503d04472b8510635ce8d94c52"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "08820c93fc936668b389a94c267f2082"
server_key_iv: "94503ce873be750228b4647c1f854040"
server_key_version: "encryptionkey@0"
I20260809 03:26:11.287410 24693 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:26:11.288175 24709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:11.288348 24693 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:26:11.288455 24693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "8a6fcf503d04472b8510635ce8d94c52"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "08820c93fc936668b389a94c267f2082"
server_key_iv: "94503ce873be750228b4647c1f854040"
server_key_version: "encryptionkey@0"
I20260809 03:26:11.288528 24693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:26:11.312006 24693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:26:11.313906 24693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:26:11.314074 24693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:26:11.318212 24693 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:38695
I20260809 03:26:11.318282 24769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:38695 every 8 connection(s)
I20260809 03:26:11.318630 24693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:26:11.319547 24770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:26:11.321893 24770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: Bootstrap starting.
I20260809 03:26:11.322515 24770 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: Neither blocks nor log segments found. Creating new log.
I20260809 03:26:11.322820 24770 log.cc:824] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: Log is configured to *not* fsync() on all Append() calls
I20260809 03:26:11.323553 24770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: No bootstrap required, opened a new log
I20260809 03:26:11.324760 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 24693
I20260809 03:26:11.324877 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:26:11.325047 8215 external_mini_cluster.cc:1428] Setting key 22a826b9d6b94c4299a383660c550aa8
I20260809 03:26:11.325292 24770 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a6fcf503d04472b8510635ce8d94c52" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38695 } }
I20260809 03:26:11.325493 24770 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:26:11.325606 24770 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a6fcf503d04472b8510635ce8d94c52, State: Initialized, Role: FOLLOWER
I20260809 03:26:11.325776 24770 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a6fcf503d04472b8510635ce8d94c52" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38695 } }
I20260809 03:26:11.325865 24770 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:26:11.325887 24770 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:26:11.325958 24770 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:26:11.327083 24770 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a6fcf503d04472b8510635ce8d94c52" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38695 } }
I20260809 03:26:11.327174 24770 leader_election.cc:302] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a6fcf503d04472b8510635ce8d94c52; no voters:
I20260809 03:26:11.327368 24770 leader_election.cc:288] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:26:11.327414 24775 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:26:11.327585 24775 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 1 LEADER]: Becoming Leader. State: Replica: 8a6fcf503d04472b8510635ce8d94c52, State: Running, Role: LEADER
I20260809 03:26:11.327628 24770 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:26:11.327791 24775 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a6fcf503d04472b8510635ce8d94c52" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38695 } }
I20260809 03:26:11.328903 24777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a6fcf503d04472b8510635ce8d94c52. Latest consensus state: current_term: 1 leader_uuid: "8a6fcf503d04472b8510635ce8d94c52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a6fcf503d04472b8510635ce8d94c52" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38695 } } }
I20260809 03:26:11.328991 24777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [sys.catalog]: This master's current role is: LEADER
I20260809 03:26:11.329231 24791 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:26:11.329360 24776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a6fcf503d04472b8510635ce8d94c52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a6fcf503d04472b8510635ce8d94c52" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38695 } } }
I20260809 03:26:11.329473 24776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [sys.catalog]: This master's current role is: LEADER
I20260809 03:26:11.329959 24791 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:26:11.331525 24791 catalog_manager.cc:1347] Generated new cluster ID: 738b471f162a423fad7cff1e25189ada
I20260809 03:26:11.331583 24791 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 03:26:11 dist-test-slave-2w3w krb5kdc[24679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245971, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:26:11.337322 24774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.325580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42418 (local address 127.8.5.254:38695)
0809 03:26:11.325788 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:11.325797 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:11.325827 (+ 30us) server_negotiation.cc:407] Connection header received
0809 03:26:11.325964 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:11.325971 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:11.326026 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:11.326147 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:26:11.327044 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.328542 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.329682 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.330285 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.330400 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.333335 (+ 2935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:26:11.333338 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:26:11.333338 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:26:11.333349 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:26:11.335331 (+ 1982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:11.335729 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:11.335733 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:11.335733 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:11.336171 (+ 438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:11.336414 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:11.336415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:11.336416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:11.336707 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:26:11.336841 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:11.336976 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 03:26:11.337100 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":108,"threads_started":1}
I20260809 03:26:11.344254 24791 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:26:11.345108 24791 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:26:11.348951 24791 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: Generated new TSK 0
I20260809 03:26:11.349134 24791 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
I20260809 03:26:11.377300 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:38695
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:26:11.459882 24797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:26:11.460070 24797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:26:11.460093 24797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:26:11.461249 24797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:26:11.461290 24797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:26:11.461316 24797 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:26:11.462716 24797 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:38695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:26:11.462994 24797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:26:11.463272 24797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:26:11.468349 24802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:26:11.468340 24803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:26:11.468340 24805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:26:11.468547 24797 server_base.cc:1034] running on GCE node
I20260809 03:26:11.468731 24797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:26:11.468953 24797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:26:11.470139 24797 hybrid_clock.cc:648] HybridClock initialized: now 1786245971470127 us; error 29 us; skew 500 ppm
Aug 09 03:26:11 dist-test-slave-2w3w krb5kdc[24679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245971, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:26:11.472797 24797 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:26:11.473177 24797 webserver.cc:460] Webserver started at http://127.8.5.193:38573/ using document root <none> and password file <none>
I20260809 03:26:11.473359 24797 fs_manager.cc:359] Metadata directory not provided
I20260809 03:26:11.473399 24797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:26:11.473484 24797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:26:11.474455 24797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "72e69a94821b4ca6ac6cd3ff35a768ca"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "f1faf53492f2ecd2d75bd35a90bd687f"
server_key_iv: "d9c82fa11a6c1a37b3d765a594d3a003"
server_key_version: "encryptionkey@0"
I20260809 03:26:11.474771 24797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "72e69a94821b4ca6ac6cd3ff35a768ca"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "f1faf53492f2ecd2d75bd35a90bd687f"
server_key_iv: "d9c82fa11a6c1a37b3d765a594d3a003"
server_key_version: "encryptionkey@0"
I20260809 03:26:11.476073 24797 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:26:11.476756 24812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:11.476923 24797 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:26:11.477027 24797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "72e69a94821b4ca6ac6cd3ff35a768ca"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "f1faf53492f2ecd2d75bd35a90bd687f"
server_key_iv: "d9c82fa11a6c1a37b3d765a594d3a003"
server_key_version: "encryptionkey@0"
I20260809 03:26:11.477101 24797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:26:11.507369 24797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:26:11.509868 24797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:26:11.510043 24797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:26:11.510304 24797 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:26:11.510622 24797 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:26:11.510674 24797 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:11.510715 24797 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:26:11.510742 24797 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:11.516624 24797 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:33891
I20260809 03:26:11.516724 24939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:33891 every 8 connection(s)
I20260809 03:26:11.517036 24797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:26:11.522940 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 24797
I20260809 03:26:11.523106 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:26:11.523319 8215 external_mini_cluster.cc:1428] Setting key dbd0df1eb8d8c6f8fd71f970ba974255
Aug 09 03:26:11 dist-test-slave-2w3w krb5kdc[24679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245971, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:26:11.526897 24774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.517853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:47093 (local address 127.8.5.254:38695)
0809 03:26:11.517933 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:11.517935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:11.518218 (+ 283us) server_negotiation.cc:407] Connection header received
0809 03:26:11.518758 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:11.518760 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:11.518776 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:11.518829 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:26:11.519871 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.520449 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.521454 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.521672 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.521754 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.524023 (+ 2269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:26:11.524025 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:26:11.524025 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:26:11.524036 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:26:11.525440 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:11.525869 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:11.525870 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:11.525871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:11.525930 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:11.526202 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:11.526203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:11.526204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:11.526333 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:26:11.526406 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:11.526692 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 03:26:11.526803 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 03:26:11.527688 24942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.517752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:47093)
0809 03:26:11.518096 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:11.518131 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:11.518643 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:11.518898 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:26:11.518902 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:26:11.519539 (+ 637us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:26:11.519748 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:11.519754 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.520546 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.520547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:11.521350 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:11.521352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.521766 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.521767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:11.521900 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.522358 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:26:11.522365 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:26:11.523921 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:26:11.525539 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:26:11.525547 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:26:11.525549 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:26:11.525778 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:26:11.526010 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:26:11.526011 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:26:11.526011 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:26:11.526125 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:26:11.526412 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:26:11.526420 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:26:11.526558 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 03:26:11.526668 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 03:26:11.526860 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":101,"threads_started":1}
I20260809 03:26:11.528342 24940 heartbeater.cc:347] Connected to a master server at 127.8.5.254:38695
I20260809 03:26:11.528460 24940 heartbeater.cc:464] Registering TS with master...
I20260809 03:26:11.528697 24940 heartbeater.cc:511] Master 127.8.5.254:38695 requested a full tablet report, sending...
I20260809 03:26:11.529309 24727 ts_manager.cc:194] Registered new tserver with Master: 72e69a94821b4ca6ac6cd3ff35a768ca (127.8.5.193:33891)
I20260809 03:26:11.529927 24727 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:47093
WARNING: no policy specified for kudu/127.8.5.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
I20260809 03:26:11.551864 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:38695
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:26:11.632755 24945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:26:11.632990 24945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:26:11.633025 24945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:26:11.634212 24945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:26:11.634279 24945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:26:11.634322 24945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:26:11.635792 24945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:38695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24945
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:26:11.636056 24945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:26:11.636276 24945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:26:11.641108 24953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:26:11.641157 24951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:26:11.641108 24950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:26:11.641149 24945 server_base.cc:1034] running on GCE node
I20260809 03:26:11.641554 24945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:26:11.641798 24945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:26:11.642993 24945 hybrid_clock.cc:648] HybridClock initialized: now 1786245971642941 us; error 24 us; skew 500 ppm
Aug 09 03:26:11 dist-test-slave-2w3w krb5kdc[24679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245971, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:26:11.645524 24945 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:26:11.645975 24945 webserver.cc:460] Webserver started at http://127.8.5.194:43697/ using document root <none> and password file <none>
I20260809 03:26:11.646188 24945 fs_manager.cc:359] Metadata directory not provided
I20260809 03:26:11.646232 24945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:26:11.646360 24945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:26:11.647446 24945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "8a6cdb0a39e24635886f38345de09aa7"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "d0b0d1713aebb60d718d14e0f96de50c"
server_key_iv: "ee26b2e1c14ab4be55c865b97b34a0f9"
server_key_version: "encryptionkey@0"
I20260809 03:26:11.647853 24945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "8a6cdb0a39e24635886f38345de09aa7"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "d0b0d1713aebb60d718d14e0f96de50c"
server_key_iv: "ee26b2e1c14ab4be55c865b97b34a0f9"
server_key_version: "encryptionkey@0"
I20260809 03:26:11.649227 24945 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:26:11.649937 24961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:11.650101 24945 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:26:11.650198 24945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "8a6cdb0a39e24635886f38345de09aa7"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "d0b0d1713aebb60d718d14e0f96de50c"
server_key_iv: "ee26b2e1c14ab4be55c865b97b34a0f9"
server_key_version: "encryptionkey@0"
I20260809 03:26:11.650276 24945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:26:11.657641 24945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:26:11.659545 24945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:26:11.659696 24945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:26:11.659941 24945 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:26:11.660234 24945 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:26:11.660290 24945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:11.660331 24945 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:26:11.660359 24945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:11.666036 24945 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:33923
I20260809 03:26:11.666071 25085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:33923 every 8 connection(s)
I20260809 03:26:11.666373 24945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:26:11.667043 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 24945
I20260809 03:26:11.667173 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:26:11.667404 8215 external_mini_cluster.cc:1428] Setting key fa9afb5b10c19c275ba73ecad347cf26
Aug 09 03:26:11 dist-test-slave-2w3w krb5kdc[24679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245971, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.5.195@KRBTEST.COM; defaulting to no policy
I20260809 03:26:11.676573 24774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.667135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:47999 (local address 127.8.5.254:38695)
0809 03:26:11.667321 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:11.667323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:11.667402 (+ 79us) server_negotiation.cc:407] Connection header received
0809 03:26:11.668085 (+ 683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:11.668086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:11.668097 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:11.668154 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:26:11.669472 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.670039 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.671090 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.671308 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.671392 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.673598 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:26:11.673601 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:26:11.673601 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:26:11.673610 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:26:11.675183 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:11.675590 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:11.675591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:11.675591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:11.675653 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:11.675914 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:11.675915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:11.675915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:11.676029 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:26:11.676106 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:11.676384 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 03:26:11.676477 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151}
I20260809 03:26:11.676800 25088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.667084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:47999)
0809 03:26:11.667255 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:11.667307 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:11.667917 (+ 610us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:11.668251 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:26:11.668256 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:26:11.669103 (+ 847us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:26:11.669375 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:11.669380 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.670147 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.670148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:11.671008 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:11.671011 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.671404 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.671405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:11.671528 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.672086 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:26:11.672094 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:26:11.673508 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:26:11.675265 (+ 1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:26:11.675273 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:26:11.675275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:26:11.675509 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:26:11.675729 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:26:11.675730 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:26:11.675731 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:26:11.675839 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:26:11.676097 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:26:11.676105 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:26:11.676246 (+ 141us) client_negotiation.cc:769] Sending connection context
0809 03:26:11.676362 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 03:26:11.676521 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":85,"threads_started":1}
I20260809 03:26:11.677275 25086 heartbeater.cc:347] Connected to a master server at 127.8.5.254:38695
I20260809 03:26:11.677361 25086 heartbeater.cc:464] Registering TS with master...
I20260809 03:26:11.677560 25086 heartbeater.cc:511] Master 127.8.5.254:38695 requested a full tablet report, sending...
I20260809 03:26:11.677948 24727 ts_manager.cc:194] Registered new tserver with Master: 8a6cdb0a39e24635886f38345de09aa7 (127.8.5.194:33923)
I20260809 03:26:11.678306 24727 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:47999
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
I20260809 03:26:11.693754 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:38695
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:26:11.775324 25092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:26:11.775513 25092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:26:11.775537 25092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:26:11.776657 25092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:26:11.776698 25092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:26:11.776724 25092 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:26:11.778136 25092 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:38695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:26:11.778373 25092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:26:11.778613 25092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:26:11.783540 25099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:26:11.783540 25102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:26:11.783655 25092 server_base.cc:1034] running on GCE node
W20260809 03:26:11.783586 25098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:26:11.784001 25092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:26:11.784189 25092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:26:11.785329 25092 hybrid_clock.cc:648] HybridClock initialized: now 1786245971785318 us; error 28 us; skew 500 ppm
Aug 09 03:26:11 dist-test-slave-2w3w krb5kdc[24679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245971, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:26:11.787896 25092 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:26:11.788385 25092 webserver.cc:460] Webserver started at http://127.8.5.195:46487/ using document root <none> and password file <none>
I20260809 03:26:11.788599 25092 fs_manager.cc:359] Metadata directory not provided
I20260809 03:26:11.788640 25092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:26:11.788726 25092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:26:11.789654 25092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "b762adb0131d4a38be7ce7537d7566ef"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "28f15b8b7ec3156454450daa9da69b6d"
server_key_iv: "ed4f153cc691afac8c678a0d74ecbd47"
server_key_version: "encryptionkey@0"
I20260809 03:26:11.789947 25092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "b762adb0131d4a38be7ce7537d7566ef"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "28f15b8b7ec3156454450daa9da69b6d"
server_key_iv: "ed4f153cc691afac8c678a0d74ecbd47"
server_key_version: "encryptionkey@0"
I20260809 03:26:11.791339 25092 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260809 03:26:11.792053 25109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:11.792234 25092 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:26:11.792303 25092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "b762adb0131d4a38be7ce7537d7566ef"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "28f15b8b7ec3156454450daa9da69b6d"
server_key_iv: "ed4f153cc691afac8c678a0d74ecbd47"
server_key_version: "encryptionkey@0"
I20260809 03:26:11.792389 25092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:26:11.824667 25092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:26:11.826759 25092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:26:11.826928 25092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:26:11.827292 25092 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:26:11.827699 25092 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:26:11.827739 25092 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:11.827762 25092 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:26:11.827775 25092 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:11.833767 25092 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:35865
I20260809 03:26:11.833871 25233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:35865 every 8 connection(s)
I20260809 03:26:11.834165 25092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:26:11.839418 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 25092
I20260809 03:26:11.839505 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:26:11.839671 8215 external_mini_cluster.cc:1428] Setting key 02db71a154e93f4e7e6f2780b78cb147
Aug 09 03:26:11 dist-test-slave-2w3w krb5kdc[24679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245971, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:26:11.843587 24774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.834904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:36669 (local address 127.8.5.254:38695)
0809 03:26:11.834951 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:11.834953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:11.835170 (+ 217us) server_negotiation.cc:407] Connection header received
0809 03:26:11.835654 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:11.835656 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:11.835665 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:11.835727 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:26:11.836666 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.837199 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.838334 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.838520 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.838580 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.840862 (+ 2282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:26:11.840863 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:26:11.840863 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:26:11.840870 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:26:11.842199 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:11.842575 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:11.842576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:11.842576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:11.842631 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:11.843046 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:11.843047 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:11.843048 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:11.843167 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:26:11.843224 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:11.843461 (+ 237us) server_negotiation.cc:299] Negotiation successful
0809 03:26:11.843523 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 03:26:11.843760 25236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.834868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:36669)
0809 03:26:11.835051 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:11.835093 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:11.835569 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:11.835798 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:26:11.835801 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:26:11.836350 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:26:11.836557 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:11.836562 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.837293 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.837294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:11.838257 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:11.838259 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.838599 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.838599 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:11.838694 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.839282 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:26:11.839290 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:26:11.840780 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:26:11.842273 (+ 1493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:26:11.842279 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:26:11.842280 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:26:11.842508 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:26:11.842802 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:26:11.842803 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:26:11.842803 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:26:11.842931 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:26:11.843227 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:26:11.843232 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:26:11.843344 (+ 112us) client_negotiation.cc:769] Sending connection context
0809 03:26:11.843422 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 03:26:11.843539 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":109,"threads_started":1}
I20260809 03:26:11.844236 25234 heartbeater.cc:347] Connected to a master server at 127.8.5.254:38695
I20260809 03:26:11.844316 25234 heartbeater.cc:464] Registering TS with master...
I20260809 03:26:11.844554 25234 heartbeater.cc:511] Master 127.8.5.254:38695 requested a full tablet report, sending...
I20260809 03:26:11.844928 24727 ts_manager.cc:194] Registered new tserver with Master: b762adb0131d4a38be7ce7537d7566ef (127.8.5.195:35865)
I20260809 03:26:11.845309 24727 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:36669
I20260809 03:26:11.852123 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:26:11.859139 24774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.853467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42426 (local address 127.8.5.254:38695)
0809 03:26:11.853539 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:11.853541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:11.853571 (+ 30us) server_negotiation.cc:407] Connection header received
0809 03:26:11.853628 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:11.853629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:11.853637 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:11.853684 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:26:11.854300 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.854771 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.855547 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.855722 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.855773 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.856857 (+ 1084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:26:11.856858 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:26:11.856859 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:26:11.856864 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:26:11.858000 (+ 1136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:11.858306 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:11.858307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:11.858307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:11.858353 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:11.858513 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:11.858514 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:11.858514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:11.858643 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:26:11.858716 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:11.858916 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 03:26:11.859045 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 03:26:11.860882 24727 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42426:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:26:11.862401 24727 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:26:11.868777 25249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.864641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:33923 (local address 127.0.0.1:37148)
0809 03:26:11.865025 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:11.865034 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:11.865087 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:11.865354 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:26:11.865357 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:26:11.865363 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:26:11.865433 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:11.865435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.866440 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.866441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:11.867773 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:11.867776 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.868472 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.868473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:11.868551 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.868563 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 03:26:11.868652 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 03:26:11.868705 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"mutex_wait_us":3,"thread_start_us":82,"threads_started":1}
I20260809 03:26:11.868786 25251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.864758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37148 (local address 127.8.5.194:33923)
0809 03:26:11.865013 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:11.865017 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:11.865082 (+ 65us) server_negotiation.cc:407] Connection header received
0809 03:26:11.865160 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:11.865162 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:11.865180 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:11.865515 (+ 335us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:26:11.865597 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.866336 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.867874 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.868387 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.868473 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.868533 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:11.868670 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 03:26:11.868710 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":101,"threads_started":1}
I20260809 03:26:11.869099 25250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.864741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45812 (local address 127.8.5.195:35865)
0809 03:26:11.864976 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:11.864981 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:11.865143 (+ 162us) server_negotiation.cc:407] Connection header received
0809 03:26:11.865186 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:11.865188 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:11.865204 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:11.865273 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:26:11.865507 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.866608 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.867895 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.868622 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.868693 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.868744 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:11.868983 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 03:26:11.869029 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":84,"threads_started":1}
I20260809 03:26:11.869095 25248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.864641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:35865 (local address 127.0.0.1:45812)
0809 03:26:11.864931 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:11.864975 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:11.865057 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:11.865355 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:26:11.865357 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:26:11.865360 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:26:11.865424 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:11.865426 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.866714 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.866715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:11.867801 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:11.867803 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.868782 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.868783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:11.868897 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.868901 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:26:11.868961 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 03:26:11.869006 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":39,"thread_start_us":50,"threads_started":1}
I20260809 03:26:11.869362 25253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.865082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37510 (local address 127.8.5.193:33891)
0809 03:26:11.865258 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:11.865262 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:11.865336 (+ 74us) server_negotiation.cc:407] Connection header received
0809 03:26:11.865495 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:11.865498 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:11.865513 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:11.865583 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:26:11.865792 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.866808 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.867953 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.868622 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.868692 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.868744 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:11.869205 (+ 461us) server_negotiation.cc:299] Negotiation successful
0809 03:26:11.869252 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":89,"threads_started":1}
I20260809 03:26:11.869095 25252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.864865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:33891 (local address 127.0.0.1:37510)
0809 03:26:11.865264 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:11.865274 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:11.865390 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:11.865663 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:26:11.865664 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:26:11.865665 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:26:11.865705 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:11.865706 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.866904 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.866905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:11.867865 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:11.867868 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.868786 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.868786 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:11.868885 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.868891 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 03:26:11.868961 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 03:26:11.869004 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"mutex_wait_us":6,"thread_start_us":68,"threads_started":1}
I20260809 03:26:11.870064 25016 tablet_service.cc:1467] Processing CreateTablet for tablet 4628043c587b4881b7d8b6b7afa81756 (DEFAULT_TABLE table=test-table [id=250e86d848c44e1dabbc471b6665aee2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:26:11.870082 25164 tablet_service.cc:1467] Processing CreateTablet for tablet 4628043c587b4881b7d8b6b7afa81756 (DEFAULT_TABLE table=test-table [id=250e86d848c44e1dabbc471b6665aee2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:26:11.870417 25164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4628043c587b4881b7d8b6b7afa81756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:26:11.870422 25016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4628043c587b4881b7d8b6b7afa81756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:26:11.873128 25254 tablet_bootstrap.cc:492] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef: Bootstrap starting.
I20260809 03:26:11.873134 25255 tablet_bootstrap.cc:492] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7: Bootstrap starting.
I20260809 03:26:11.873879 25255 tablet_bootstrap.cc:654] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7: Neither blocks nor log segments found. Creating new log.
I20260809 03:26:11.873891 25254 tablet_bootstrap.cc:654] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef: Neither blocks nor log segments found. Creating new log.
I20260809 03:26:11.873836 24867 tablet_service.cc:1467] Processing CreateTablet for tablet 4628043c587b4881b7d8b6b7afa81756 (DEFAULT_TABLE table=test-table [id=250e86d848c44e1dabbc471b6665aee2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:26:11.874238 24867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4628043c587b4881b7d8b6b7afa81756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:26:11.874433 25255 log.cc:824] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7: Log is configured to *not* fsync() on all Append() calls
I20260809 03:26:11.874495 25254 log.cc:824] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef: Log is configured to *not* fsync() on all Append() calls
I20260809 03:26:11.875207 25255 tablet_bootstrap.cc:492] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7: No bootstrap required, opened a new log
I20260809 03:26:11.875295 25255 ts_tablet_manager.cc:1397] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:26:11.875639 25254 tablet_bootstrap.cc:492] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef: No bootstrap required, opened a new log
I20260809 03:26:11.875713 25254 ts_tablet_manager.cc:1397] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 03:26:11.877305 25258 tablet_bootstrap.cc:492] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca: Bootstrap starting.
I20260809 03:26:11.877568 25255 raft_consensus.cc:348] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:11.877764 25255 raft_consensus.cc:374] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:26:11.877708 25254 raft_consensus.cc:348] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:11.877823 25255 raft_consensus.cc:729] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a6cdb0a39e24635886f38345de09aa7, State: Initialized, Role: FOLLOWER
I20260809 03:26:11.877866 25254 raft_consensus.cc:374] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:26:11.877911 25254 raft_consensus.cc:729] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b762adb0131d4a38be7ce7537d7566ef, State: Initialized, Role: FOLLOWER
I20260809 03:26:11.877954 25258 tablet_bootstrap.cc:654] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca: Neither blocks nor log segments found. Creating new log.
I20260809 03:26:11.877969 25255 consensus_queue.cc:260] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:11.878021 25254 consensus_queue.cc:260] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:11.878266 25254 ts_tablet_manager.cc:1428] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 03:26:11.878302 25086 heartbeater.cc:503] Master 127.8.5.254:38695 was elected leader, sending a full tablet report...
I20260809 03:26:11.878403 25234 heartbeater.cc:503] Master 127.8.5.254:38695 was elected leader, sending a full tablet report...
I20260809 03:26:11.878518 25258 log.cc:824] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca: Log is configured to *not* fsync() on all Append() calls
I20260809 03:26:11.878659 25255 ts_tablet_manager.cc:1428] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 03:26:11.879292 25258 tablet_bootstrap.cc:492] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca: No bootstrap required, opened a new log
I20260809 03:26:11.879359 25258 ts_tablet_manager.cc:1397] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:26:11.881007 25258 raft_consensus.cc:348] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:11.881132 25258 raft_consensus.cc:374] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:26:11.881153 25258 raft_consensus.cc:729] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72e69a94821b4ca6ac6cd3ff35a768ca, State: Initialized, Role: FOLLOWER
I20260809 03:26:11.881284 25258 consensus_queue.cc:260] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:11.881556 25258 ts_tablet_manager.cc:1428] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:26:11.881577 24940 heartbeater.cc:503] Master 127.8.5.254:38695 was elected leader, sending a full tablet report...
I20260809 03:26:11.898154 25260 raft_consensus.cc:482] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:26:11.898241 25260 raft_consensus.cc:504] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:11.898586 25260 leader_election.cc:288] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a6cdb0a39e24635886f38345de09aa7 (127.8.5.194:33923), 72e69a94821b4ca6ac6cd3ff35a768ca (127.8.5.193:33891)
I20260809 03:26:11.901791 25236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.898768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:33923 (local address 127.8.5.195:37117)
0809 03:26:11.898821 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:11.898833 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:11.898874 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:11.899102 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:26:11.899103 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:26:11.899105 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:26:11.899201 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:11.899203 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.900177 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.900178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:11.900956 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:11.900958 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.901533 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.901534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:11.901622 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.901625 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:26:11.901667 (+ 42us) client_negotiation.cc:240] Negotiation successful
0809 03:26:11.901699 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260809 03:26:11.901803 25251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.898836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:37117 (local address 127.8.5.194:33923)
0809 03:26:11.898899 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:11.898901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:11.898915 (+ 14us) server_negotiation.cc:407] Connection header received
0809 03:26:11.898946 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:11.898947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:11.898991 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:11.899071 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:26:11.899271 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.900091 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.901047 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.901446 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.901501 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.901510 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:11.901692 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 03:26:11.901738 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 03:26:11.901883 25253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.899000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:54979 (local address 127.8.5.193:33891)
0809 03:26:11.899061 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:11.899063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:11.899181 (+ 118us) server_negotiation.cc:407] Connection header received
0809 03:26:11.899209 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:11.899210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:11.899218 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:11.899285 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:26:11.899404 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.900124 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.901095 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.901494 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.901568 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.901577 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:11.901761 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 03:26:11.901808 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 03:26:11.901988 25263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.898881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:33891 (local address 127.8.5.195:54979)
0809 03:26:11.899092 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:11.899101 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:11.899155 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:11.899291 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:26:11.899291 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:26:11.899292 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:26:11.899341 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:11.899342 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.900210 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.900212 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:11.900979 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:11.900981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.901593 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.901594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:11.901676 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.901685 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 03:26:11.901742 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 03:26:11.901778 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":151,"threads_started":1}
I20260809 03:26:11.902225 25038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4628043c587b4881b7d8b6b7afa81756" candidate_uuid: "b762adb0131d4a38be7ce7537d7566ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a6cdb0a39e24635886f38345de09aa7" is_pre_election: true
I20260809 03:26:11.902282 24890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4628043c587b4881b7d8b6b7afa81756" candidate_uuid: "b762adb0131d4a38be7ce7537d7566ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" is_pre_election: true
I20260809 03:26:11.902355 25038 raft_consensus.cc:2454] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b762adb0131d4a38be7ce7537d7566ef in term 0.
I20260809 03:26:11.902439 24890 raft_consensus.cc:2454] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b762adb0131d4a38be7ce7537d7566ef in term 0.
I20260809 03:26:11.902587 25112 leader_election.cc:302] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a6cdb0a39e24635886f38345de09aa7, b762adb0131d4a38be7ce7537d7566ef; no voters:
I20260809 03:26:11.902720 25260 raft_consensus.cc:2781] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:26:11.902779 25260 raft_consensus.cc:482] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:26:11.902812 25260 raft_consensus.cc:3037] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:26:11.903535 25260 raft_consensus.cc:504] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:11.903658 25260 leader_election.cc:288] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [CANDIDATE]: Term 1 election: Requested vote from peers 8a6cdb0a39e24635886f38345de09aa7 (127.8.5.194:33923), 72e69a94821b4ca6ac6cd3ff35a768ca (127.8.5.193:33891)
I20260809 03:26:11.903820 24890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4628043c587b4881b7d8b6b7afa81756" candidate_uuid: "b762adb0131d4a38be7ce7537d7566ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca"
I20260809 03:26:11.903843 25038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4628043c587b4881b7d8b6b7afa81756" candidate_uuid: "b762adb0131d4a38be7ce7537d7566ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a6cdb0a39e24635886f38345de09aa7"
I20260809 03:26:11.903900 24890 raft_consensus.cc:3037] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:26:11.903929 25038 raft_consensus.cc:3037] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:26:11.904624 25038 raft_consensus.cc:2454] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b762adb0131d4a38be7ce7537d7566ef in term 1.
I20260809 03:26:11.904665 24890 raft_consensus.cc:2454] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b762adb0131d4a38be7ce7537d7566ef in term 1.
I20260809 03:26:11.904826 25112 leader_election.cc:302] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72e69a94821b4ca6ac6cd3ff35a768ca, b762adb0131d4a38be7ce7537d7566ef; no voters:
I20260809 03:26:11.904917 25260 raft_consensus.cc:2781] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:26:11.905062 25260 raft_consensus.cc:686] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [term 1 LEADER]: Becoming Leader. State: Replica: b762adb0131d4a38be7ce7537d7566ef, State: Running, Role: LEADER
I20260809 03:26:11.905158 25260 consensus_queue.cc:237] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:11.905915 24726 catalog_manager.cc:5495] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef reported cstate change: term changed from 0 to 1, leader changed from <none> to b762adb0131d4a38be7ce7537d7566ef (127.8.5.195). New cstate: current_term: 1 leader_uuid: "b762adb0131d4a38be7ce7537d7566ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } health_report { overall_health: UNKNOWN } } }
I20260809 03:26:11.914485 25250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.912439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45818 (local address 127.8.5.195:35865)
0809 03:26:11.912477 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:11.912479 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:11.912490 (+ 11us) server_negotiation.cc:407] Connection header received
0809 03:26:11.912580 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:11.912580 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:11.912595 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:11.912646 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:26:11.912731 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.913159 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.913857 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:11.914033 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:11.914080 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:11.914201 (+ 121us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:26:11.914285 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:26:11.914338 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:11.914386 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 03:26:11.914400 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:26:11.916221 24890 raft_consensus.cc:1261] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Refusing update from remote peer b762adb0131d4a38be7ce7537d7566ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:26:11.916221 25038 raft_consensus.cc:1261] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7 [term 1 FOLLOWER]: Refusing update from remote peer b762adb0131d4a38be7ce7537d7566ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:26:11.916568 25266 consensus_queue.cc:1035] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:26:11.916703 25260 consensus_queue.cc:1035] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 03:26:11.916888 25087 tablet.cc:2369] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:26:11.919636 25271 mvcc.cc:205] Tried to move back new op lower bound from 7316463500966215680 to 7316463500924170240. Current Snapshot: MvccSnapshot[applied={T|T < 7316463500966215680}]
I20260809 03:26:11.921978 24727 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42426:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:26:11.922070 24727 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42426:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:26:11.922830 24727 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: Sending DeleteTablet for 3 replicas of tablet 4628043c587b4881b7d8b6b7afa81756
I20260809 03:26:11.923238 25016 tablet_service.cc:1514] Processing DeleteTablet for tablet 4628043c587b4881b7d8b6b7afa81756 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:26:11 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:37148
I20260809 03:26:11.923331 25164 tablet_service.cc:1514] Processing DeleteTablet for tablet 4628043c587b4881b7d8b6b7afa81756 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:26:11 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:45812
I20260809 03:26:11.923326 24867 tablet_service.cc:1514] Processing DeleteTablet for tablet 4628043c587b4881b7d8b6b7afa81756 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:26:11 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:37510
I20260809 03:26:11.923564 25282 tablet_replica.cc:330] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7: stopping tablet replica
I20260809 03:26:11.923661 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 24797
I20260809 03:26:11.923669 25282 raft_consensus.cc:2229] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:26:11.923774 25282 raft_consensus.cc:2258] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:26:11.923943 25284 tablet_replica.cc:330] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef: stopping tablet replica
I20260809 03:26:11.925572 25284 raft_consensus.cc:2229] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:26:11.925694 25284 raft_consensus.cc:2258] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:26:11.926927 25282 ts_tablet_manager.cc:1905] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:26:11.928977 25282 ts_tablet_manager.cc:1918] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:26:11.929055 25282 log.cc:1196] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/4628043c587b4881b7d8b6b7afa81756
I20260809 03:26:11.929344 25282 ts_tablet_manager.cc:1939] T 4628043c587b4881b7d8b6b7afa81756 P 8a6cdb0a39e24635886f38345de09aa7: Deleting consensus metadata
I20260809 03:26:11.929777 24712 catalog_manager.cc:4841] TS 8a6cdb0a39e24635886f38345de09aa7 (127.8.5.194:33923): tablet 4628043c587b4881b7d8b6b7afa81756 (table test-table [id=250e86d848c44e1dabbc471b6665aee2]) successfully deleted
I20260809 03:26:11.929884 25284 ts_tablet_manager.cc:1905] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:26:11.931932 25284 ts_tablet_manager.cc:1918] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:26:11.932010 25284 log.cc:1196] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/4628043c587b4881b7d8b6b7afa81756
I20260809 03:26:11.932293 25284 ts_tablet_manager.cc:1939] T 4628043c587b4881b7d8b6b7afa81756 P b762adb0131d4a38be7ce7537d7566ef: Deleting consensus metadata
I20260809 03:26:11.932812 24710 catalog_manager.cc:4841] TS b762adb0131d4a38be7ce7537d7566ef (127.8.5.195:35865): tablet 4628043c587b4881b7d8b6b7afa81756 (table test-table [id=250e86d848c44e1dabbc471b6665aee2]) successfully deleted
W20260809 03:26:11.933421 24712 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.5.193:33891 (error 108)
I20260809 03:26:11.933697 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 24945
I20260809 03:26:11.935387 25252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:11.933820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:33891 (local address 127.0.0.1:37518)
0809 03:26:11.935302 (+ 1482us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:11.935351 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.193:33891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1456}
W20260809 03:26:11.936092 24712 catalog_manager.cc:4584] TS 72e69a94821b4ca6ac6cd3ff35a768ca (127.8.5.193:33891): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4628043c587b4881b7d8b6b7afa81756: Network error: Client connection negotiation failed: client connection to 127.8.5.193:33891: connect: Connection refused (error 111)
I20260809 03:26:11.940711 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 25092
I20260809 03:26:11.947644 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 24693
I20260809 03:26:31.954727 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:38695
--webserver_interface=127.8.5.254
--webserver_port=40011
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:38695
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:26:32.035909 25286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:26:32.036155 25286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:26:32.036195 25286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:26:32.037356 25286 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 03:26:32.037424 25286 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 03:26:32.037446 25286 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 03:26:32.037467 25286 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:26:32.037500 25286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:26:32.037526 25286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:26:32.037557 25286 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:26:32.037586 25286 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:26:32.039052 25286 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:38695
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:38695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=40011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:26:32.039328 25286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:26:32.039552 25286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:26:32.048611 25292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:26:32.048602 25293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:26:32.048678 25286 server_base.cc:1034] running on GCE node
W20260809 03:26:32.048602 25295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:26:32.049242 25286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:26:32.049582 25286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:26:32.050745 25286 hybrid_clock.cc:648] HybridClock initialized: now 1786245992050736 us; error 30 us; skew 500 ppm
Aug 09 03:26:32 dist-test-slave-2w3w krb5kdc[24679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245992, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:26:32.053306 25286 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:26:32.053777 25286 webserver.cc:460] Webserver started at http://127.8.5.254:40011/ using document root <none> and password file <none>
I20260809 03:26:32.054014 25286 fs_manager.cc:359] Metadata directory not provided
I20260809 03:26:32.054095 25286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:26:32.055604 25286 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:26:32.056254 25302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:32.056449 25286 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:32.056555 25286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "8a6fcf503d04472b8510635ce8d94c52"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "08820c93fc936668b389a94c267f2082"
server_key_iv: "94503ce873be750228b4647c1f854040"
server_key_version: "encryptionkey@0"
I20260809 03:26:32.056949 25286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:26:32.080201 25286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:26:32.082566 25286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:26:32.082728 25286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:26:32.086944 25286 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:38695
I20260809 03:26:32.087052 25358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:38695 every 8 connection(s)
I20260809 03:26:32.087415 25286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:26:32.088897 25359 sys_catalog.cc:263] Verifying existing consensus state
I20260809 03:26:32.089571 25359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: Bootstrap starting.
I20260809 03:26:32.090660 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 25286
I20260809 03:26:32.091020 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:33891
--local_ip_for_outbound_sockets=127.8.5.193
--tserver_master_addrs=127.8.5.254:38695
--webserver_port=38573
--webserver_interface=127.8.5.193
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 03:26:32.099321 25359 log.cc:824] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: Log is configured to *not* fsync() on all Append() calls
I20260809 03:26:32.101158 25359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 03:26:32.101452 25359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: Bootstrap complete.
I20260809 03:26:32.103812 25359 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a6fcf503d04472b8510635ce8d94c52" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38695 } }
I20260809 03:26:32.104095 25359 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a6fcf503d04472b8510635ce8d94c52, State: Initialized, Role: FOLLOWER
I20260809 03:26:32.104279 25359 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a6fcf503d04472b8510635ce8d94c52" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38695 } }
I20260809 03:26:32.104360 25359 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:26:32.104417 25359 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:26:32.104470 25359 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 1 FOLLOWER]: Advancing to term 2
I20260809 03:26:32.105433 25359 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a6fcf503d04472b8510635ce8d94c52" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38695 } }
I20260809 03:26:32.105551 25359 leader_election.cc:302] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a6fcf503d04472b8510635ce8d94c52; no voters:
I20260809 03:26:32.105741 25359 leader_election.cc:288] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 03:26:32.105777 25363 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 03:26:32.105901 25363 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 2 LEADER]: Becoming Leader. State: Replica: 8a6fcf503d04472b8510635ce8d94c52, State: Running, Role: LEADER
I20260809 03:26:32.106016 25359 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:26:32.106048 25363 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a6fcf503d04472b8510635ce8d94c52" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38695 } }
I20260809 03:26:32.106535 25364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8a6fcf503d04472b8510635ce8d94c52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a6fcf503d04472b8510635ce8d94c52" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38695 } } }
I20260809 03:26:32.106544 25366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a6fcf503d04472b8510635ce8d94c52. Latest consensus state: current_term: 2 leader_uuid: "8a6fcf503d04472b8510635ce8d94c52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a6fcf503d04472b8510635ce8d94c52" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38695 } } }
I20260809 03:26:32.106637 25364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [sys.catalog]: This master's current role is: LEADER
I20260809 03:26:32.106659 25366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [sys.catalog]: This master's current role is: LEADER
I20260809 03:26:32.107257 25372 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:26:32.107991 25372 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:26:32.108139 25372 catalog_manager.cc:1259] Loaded cluster ID: 738b471f162a423fad7cff1e25189ada
I20260809 03:26:32.108431 25372 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:26:32.109736 25372 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:26:32.109975 25372 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: Loaded TSK: 0
I20260809 03:26:32.121481 25372 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: Generated new TSK 1
I20260809 03:26:32.121572 25372 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 03:26:32.176462 25361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:26:32.176648 25361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:26:32.176671 25361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:26:32.177798 25361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:26:32.177838 25361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:26:32.177863 25361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:26:32.179294 25361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:33891
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=38573
--tserver_master_addrs=127.8.5.254:38695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:26:32.179519 25361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:26:32.179761 25361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:26:32.185457 25392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:26:32.185473 25391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:26:32.185520 25394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:26:32.185706 25361 server_base.cc:1034] running on GCE node
I20260809 03:26:32.185938 25361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:26:32.186215 25361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:26:32.187369 25361 hybrid_clock.cc:648] HybridClock initialized: now 1786245992187360 us; error 29 us; skew 500 ppm
Aug 09 03:26:32 dist-test-slave-2w3w krb5kdc[24679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245992, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:26:32.189934 25361 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:26:32.190336 25361 webserver.cc:460] Webserver started at http://127.8.5.193:38573/ using document root <none> and password file <none>
I20260809 03:26:32.190567 25361 fs_manager.cc:359] Metadata directory not provided
I20260809 03:26:32.190647 25361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:26:32.192060 25361 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:26:32.192811 25401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:32.192986 25361 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:26:32.193089 25361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "72e69a94821b4ca6ac6cd3ff35a768ca"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "f1faf53492f2ecd2d75bd35a90bd687f"
server_key_iv: "d9c82fa11a6c1a37b3d765a594d3a003"
server_key_version: "encryptionkey@0"
I20260809 03:26:32.193409 25361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:26:32.212266 25361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:26:32.214493 25361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:26:32.214648 25361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:26:32.214907 25361 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:26:32.215364 25409 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 03:26:32.217160 25361 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 03:26:32.217219 25361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 03:26:32.217260 25361 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 03:26:32.217888 25361 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 03:26:32.217941 25361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 03:26:32.218014 25409 tablet_bootstrap.cc:492] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca: Bootstrap starting.
I20260809 03:26:32.225345 25361 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:33891
I20260809 03:26:32.225701 25361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:26:32.226797 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 25361
I20260809 03:26:32.227135 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:33923
--local_ip_for_outbound_sockets=127.8.5.194
--tserver_master_addrs=127.8.5.254:38695
--webserver_port=43697
--webserver_interface=127.8.5.194
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 03:26:32.229274 25409 log.cc:824] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca: Log is configured to *not* fsync() on all Append() calls
I20260809 03:26:32.229971 25530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:33891 every 8 connection(s)
I20260809 03:26:32.231544 25409 tablet_bootstrap.cc:492] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 03:26:32.231858 25409 tablet_bootstrap.cc:492] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca: Bootstrap complete.
I20260809 03:26:32.233198 25409 ts_tablet_manager.cc:1397] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.004s
I20260809 03:26:32.234537 25409 raft_consensus.cc:348] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:32.234912 25409 raft_consensus.cc:729] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72e69a94821b4ca6ac6cd3ff35a768ca, State: Initialized, Role: FOLLOWER
I20260809 03:26:32.235123 25409 consensus_queue.cc:260] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:32.235796 25409 ts_tablet_manager.cc:1428] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
Aug 09 03:26:32 dist-test-slave-2w3w krb5kdc[24679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245992, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:26:32.241569 25534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.226388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:35889)
0809 03:26:32.226590 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:32.226632 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:32.227332 (+ 700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:32.230133 (+ 2801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:26:32.230137 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:26:32.230492 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:26:32.230761 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:32.230768 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.232373 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.232374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:32.233760 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:32.233764 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.234692 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.234693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:32.234882 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.235562 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:26:32.235572 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:26:32.237407 (+ 1835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:26:32.239850 (+ 2443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:26:32.239857 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:26:32.239859 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:26:32.240152 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:26:32.240455 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:26:32.240456 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:26:32.240457 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:26:32.240584 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:26:32.241113 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:26:32.241119 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:26:32.241227 (+ 108us) client_negotiation.cc:769] Sending connection context
0809 03:26:32.241321 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 03:26:32.241438 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":115,"threads_started":1}
I20260809 03:26:32.241712 25535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.226484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:35889 (local address 127.8.5.254:38695)
0809 03:26:32.229632 (+ 3148us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:32.229643 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:32.229695 (+ 52us) server_negotiation.cc:407] Connection header received
0809 03:26:32.229850 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:32.229857 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:32.229915 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:32.230910 (+ 995us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:26:32.231023 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.232220 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.233898 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.234570 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.235228 (+ 658us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.237522 (+ 2294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:26:32.237526 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:26:32.237526 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:26:32.237539 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:26:32.239754 (+ 2215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:32.240245 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:32.240248 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:32.240248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:32.240373 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:32.240664 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:32.240665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:32.240665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:32.241020 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:26:32.241109 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:32.241392 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 03:26:32.241529 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3087,"thread_start_us":92,"threads_started":1}
I20260809 03:26:32.242311 25531 heartbeater.cc:347] Connected to a master server at 127.8.5.254:38695
I20260809 03:26:32.242408 25531 heartbeater.cc:464] Registering TS with master...
I20260809 03:26:32.242574 25531 heartbeater.cc:511] Master 127.8.5.254:38695 requested a full tablet report, sending...
I20260809 03:26:32.243275 25321 ts_manager.cc:194] Registered new tserver with Master: 72e69a94821b4ca6ac6cd3ff35a768ca (127.8.5.193:33891)
I20260809 03:26:32.244278 25321 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:35889
I20260809 03:26:32.245221 25531 heartbeater.cc:503] Master 127.8.5.254:38695 was elected leader, sending a full tablet report...
I20260809 03:26:32.249912 25539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.243877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:33891 (local address 127.0.0.1:56586)
0809 03:26:32.247090 (+ 3213us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:32.247123 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:32.247178 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:32.247423 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:26:32.247426 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:26:32.247427 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:26:32.247482 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:32.247483 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.248246 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.248247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:32.248999 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:32.249001 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.249605 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.249606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:32.249688 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.249708 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 03:26:32.249783 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 03:26:32.249834 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3182,"thread_start_us":82,"threads_started":1}
I20260809 03:26:32.249904 25540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.243947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56586 (local address 127.8.5.193:33891)
0809 03:26:32.247277 (+ 3330us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:32.247281 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:32.247288 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:26:32.247311 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:32.247313 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:32.247325 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:32.247418 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:26:32.247562 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.248162 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.249089 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.249512 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.249592 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.249642 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:32.249798 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 03:26:32.249850 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3304,"thread_start_us":81,"threads_started":1}
I20260809 03:26:32.250352 25454 tablet_service.cc:1514] Processing DeleteTablet for tablet 4628043c587b4881b7d8b6b7afa81756 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:26:11 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:56586
I20260809 03:26:32.250803 25541 tablet_replica.cc:330] stopping tablet replica
I20260809 03:26:32.250912 25541 raft_consensus.cc:2229] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:26:32.250994 25541 raft_consensus.cc:2258] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:26:32.251315 25541 ts_tablet_manager.cc:1905] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:26:32.253849 25541 ts_tablet_manager.cc:1918] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:26:32.253924 25541 log.cc:1196] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/wal/wals/4628043c587b4881b7d8b6b7afa81756
I20260809 03:26:32.254168 25541 ts_tablet_manager.cc:1939] T 4628043c587b4881b7d8b6b7afa81756 P 72e69a94821b4ca6ac6cd3ff35a768ca: Deleting consensus metadata
I20260809 03:26:32.254637 25305 catalog_manager.cc:4841] TS 72e69a94821b4ca6ac6cd3ff35a768ca (127.8.5.193:33891): tablet 4628043c587b4881b7d8b6b7afa81756 (table test-table [id=250e86d848c44e1dabbc471b6665aee2]) successfully deleted
W20260809 03:26:32.315279 25536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:26:32.315469 25536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:26:32.315490 25536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:26:32.316627 25536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:26:32.316666 25536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:26:32.316716 25536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:26:32.318168 25536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:33923
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=43697
--tserver_master_addrs=127.8.5.254:38695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:26:32.318404 25536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:26:32.318655 25536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:26:32.323549 25546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:26:32.323675 25536 server_base.cc:1034] running on GCE node
W20260809 03:26:32.323549 25549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:26:32.323632 25547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:26:32.324014 25536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:26:32.324282 25536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:26:32.325426 25536 hybrid_clock.cc:648] HybridClock initialized: now 1786245992325420 us; error 29 us; skew 500 ppm
Aug 09 03:26:32 dist-test-slave-2w3w krb5kdc[24679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245992, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:26:32.327925 25536 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:26:32.328400 25536 webserver.cc:460] Webserver started at http://127.8.5.194:43697/ using document root <none> and password file <none>
I20260809 03:26:32.328652 25536 fs_manager.cc:359] Metadata directory not provided
I20260809 03:26:32.328734 25536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:26:32.330036 25536 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:26:32.330596 25557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:32.330770 25536 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:26:32.330868 25536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "8a6cdb0a39e24635886f38345de09aa7"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "d0b0d1713aebb60d718d14e0f96de50c"
server_key_iv: "ee26b2e1c14ab4be55c865b97b34a0f9"
server_key_version: "encryptionkey@0"
I20260809 03:26:32.331255 25536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:26:32.361918 25536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:26:32.363829 25536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:26:32.363996 25536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:26:32.364223 25536 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:26:32.364530 25536 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:26:32.364583 25536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:32.364617 25536 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:26:32.364643 25536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:32.370508 25536 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:33923
I20260809 03:26:32.370561 25679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:33923 every 8 connection(s)
I20260809 03:26:32.370880 25536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:26:32.374497 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 25536
I20260809 03:26:32.374819 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:35865
--local_ip_for_outbound_sockets=127.8.5.195
--tserver_master_addrs=127.8.5.254:38695
--webserver_port=46487
--webserver_interface=127.8.5.195
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 03:26:32 dist-test-slave-2w3w krb5kdc[24679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245992, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:26:32.380642 25682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.371581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:50263)
0809 03:26:32.371753 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:32.371788 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:32.372235 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:32.372437 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:26:32.372439 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:26:32.372978 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:26:32.373166 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:32.373170 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.373867 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.373868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:32.374847 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:32.374850 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.375370 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.375371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:32.375515 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.376028 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:26:32.376035 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:26:32.377372 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:26:32.379295 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:26:32.379302 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:26:32.379303 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:26:32.379530 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:26:32.379755 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:26:32.379756 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:26:32.379756 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:26:32.379856 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:26:32.380155 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:26:32.380159 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:26:32.380271 (+ 112us) client_negotiation.cc:769] Sending connection context
0809 03:26:32.380362 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 03:26:32.380482 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":90,"threads_started":1}
I20260809 03:26:32.380646 25535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.371593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:50263 (local address 127.8.5.254:38695)
0809 03:26:32.371662 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:32.371664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:32.371876 (+ 212us) server_negotiation.cc:407] Connection header received
0809 03:26:32.372321 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:32.372322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:32.372335 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:32.372384 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:26:32.373240 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.373750 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.375027 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.375269 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.375353 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.377465 (+ 2112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:26:32.377467 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:26:32.377467 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:26:32.377476 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:26:32.379200 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:32.379612 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:32.379614 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:32.379614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:32.379680 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:32.379925 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:32.379926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:32.379926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:32.380086 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:26:32.380163 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:32.380402 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 03:26:32.380506 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 03:26:32.381237 25680 heartbeater.cc:347] Connected to a master server at 127.8.5.254:38695
I20260809 03:26:32.381336 25680 heartbeater.cc:464] Registering TS with master...
I20260809 03:26:32.381477 25680 heartbeater.cc:511] Master 127.8.5.254:38695 requested a full tablet report, sending...
I20260809 03:26:32.381875 25321 ts_manager.cc:194] Registered new tserver with Master: 8a6cdb0a39e24635886f38345de09aa7 (127.8.5.194:33923)
I20260809 03:26:32.382416 25321 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:50263
W20260809 03:26:32.457736 25684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:26:32.457924 25684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:26:32.457947 25684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:26:32.459080 25684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:26:32.459117 25684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:26:32.459142 25684 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:26:32.460721 25684 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:35865
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=46487
--tserver_master_addrs=127.8.5.254:38695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25684
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:26:32.460892 25684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:26:32.461059 25684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:26:32.465855 25690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:26:32.465873 25692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:26:32.465843 25689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:26:32.465996 25684 server_base.cc:1034] running on GCE node
I20260809 03:26:32.466249 25684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:26:32.466506 25684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:26:32.467646 25684 hybrid_clock.cc:648] HybridClock initialized: now 1786245992467628 us; error 33 us; skew 500 ppm
Aug 09 03:26:32 dist-test-slave-2w3w krb5kdc[24679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245992, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:26:32.470170 25684 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:26:32.470634 25684 webserver.cc:460] Webserver started at http://127.8.5.195:46487/ using document root <none> and password file <none>
I20260809 03:26:32.470877 25684 fs_manager.cc:359] Metadata directory not provided
I20260809 03:26:32.470955 25684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:26:32.472316 25684 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:26:32.472874 25700 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:32.473035 25684 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:26:32.473130 25684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "b762adb0131d4a38be7ce7537d7566ef"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "28f15b8b7ec3156454450daa9da69b6d"
server_key_iv: "ed4f153cc691afac8c678a0d74ecbd47"
server_key_version: "encryptionkey@0"
I20260809 03:26:32.473439 25684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:26:32.495154 25684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:26:32.497063 25684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:26:32.497222 25684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:26:32.497484 25684 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:26:32.497808 25684 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:26:32.497849 25684 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:32.497870 25684 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:26:32.497910 25684 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:32.503790 25684 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:35865
I20260809 03:26:32.503894 25826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:35865 every 8 connection(s)
I20260809 03:26:32.504244 25684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
Aug 09 03:26:32 dist-test-slave-2w3w krb5kdc[24679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786245992, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:26:32.511144 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 25684
I20260809 03:26:32.513556 25535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.504993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:38527 (local address 127.8.5.254:38695)
0809 03:26:32.505057 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:32.505059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:32.505266 (+ 207us) server_negotiation.cc:407] Connection header received
0809 03:26:32.505836 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:32.505837 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:32.505851 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:32.505908 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:26:32.506933 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.507480 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.508471 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.508697 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.508767 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.510721 (+ 1954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:26:32.510723 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:26:32.510723 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:26:32.510731 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:26:32.512163 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:32.512582 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:32.512584 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:32.512584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:32.512665 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:32.512916 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:32.512917 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:32.512918 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:32.513036 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:26:32.513109 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:32.513382 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 03:26:32.513464 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 03:26:32.513751 25830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.504982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:38527)
0809 03:26:32.505154 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:32.505187 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:32.505727 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:32.505975 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:26:32.505979 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:26:32.506599 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:26:32.506831 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:32.506836 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.507576 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.507577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:32.508377 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:32.508380 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.508785 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.508786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:32.508923 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.509349 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:26:32.509356 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:26:32.510628 (+ 1272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:26:32.512270 (+ 1642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:26:32.512277 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:26:32.512279 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:26:32.512501 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:26:32.512741 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:26:32.512742 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:26:32.512744 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:26:32.512844 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:26:32.513113 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:26:32.513120 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:26:32.513245 (+ 125us) client_negotiation.cc:769] Sending connection context
0809 03:26:32.513357 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 03:26:32.513517 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":87,"threads_started":1}
I20260809 03:26:32.514189 25828 heartbeater.cc:347] Connected to a master server at 127.8.5.254:38695
I20260809 03:26:32.514279 25828 heartbeater.cc:464] Registering TS with master...
I20260809 03:26:32.514423 25828 heartbeater.cc:511] Master 127.8.5.254:38695 requested a full tablet report, sending...
I20260809 03:26:32.514811 25321 ts_manager.cc:194] Registered new tserver with Master: b762adb0131d4a38be7ce7537d7566ef (127.8.5.195:35865)
I20260809 03:26:32.515331 25321 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:38527
I20260809 03:26:32.518180 25832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.511580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50808 (local address 127.8.5.254:38695)
0809 03:26:32.511701 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:32.511704 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:32.511767 (+ 63us) server_negotiation.cc:407] Connection header received
0809 03:26:32.511839 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:32.511840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:32.511850 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:32.511911 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:26:32.512478 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.512962 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.513808 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.514121 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.514182 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.515971 (+ 1789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:26:32.515973 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:26:32.515973 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:26:32.515980 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:26:32.517405 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:32.517681 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:32.517681 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:32.517682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:32.517729 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:32.517837 (+ 108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:32.517837 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:32.517837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:32.517918 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:26:32.518020 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:32.518064 (+ 44us) server_negotiation.cc:299] Negotiation successful
0809 03:26:32.518122 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":72,"threads_started":1}
I20260809 03:26:32.518888 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:26:32.521384 25832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.519212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50818 (local address 127.8.5.254:38695)
0809 03:26:32.519274 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:32.519276 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:32.519336 (+ 60us) server_negotiation.cc:407] Connection header received
0809 03:26:32.519386 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:32.519387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:32.519413 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:32.519470 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:26:32.519538 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.519950 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.520679 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.520893 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.520970 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.521126 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:26:32.521176 (+ 50us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 03:26:32.521321 (+ 145us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50818: token expired
Metrics: {"server-negotiator.queue_time_us":40}
W20260809 03:26:32.521436 25832 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50818: token expired
W20260809 03:26:32.521622 25243 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.8.5.254:38695)
I20260809 03:26:32.527098 25832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.521863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50826 (local address 127.8.5.254:38695)
0809 03:26:32.521916 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:32.521917 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:32.521943 (+ 26us) server_negotiation.cc:407] Connection header received
0809 03:26:32.521999 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:32.521999 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:32.522006 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:32.522042 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:26:32.522447 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.522880 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.523543 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.523717 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.523770 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.524724 (+ 954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:26:32.524725 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:26:32.524725 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:26:32.524730 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:26:32.526197 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:32.526479 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:32.526480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:32.526480 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:32.526527 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:32.526669 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:32.526669 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:32.526670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:32.526771 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:26:32.526836 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:32.526926 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 03:26:32.527037 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 03:26:32.528163 25321 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50826:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:26:32.529719 25321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:26:32.531955 25454 tablet_service.cc:1467] Processing CreateTablet for tablet ee03419d107d4b22aaa8c2cf962a9386 (DEFAULT_TABLE table=test-table [id=72d048b276784c82ad7453d7be18c2da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:26:32.532166 25454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee03419d107d4b22aaa8c2cf962a9386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:26:32.533805 25409 tablet_bootstrap.cc:492] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca: Bootstrap starting.
I20260809 03:26:32.534190 25409 tablet_bootstrap.cc:654] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca: Neither blocks nor log segments found. Creating new log.
I20260809 03:26:32.534897 25409 tablet_bootstrap.cc:492] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca: No bootstrap required, opened a new log
I20260809 03:26:32.534965 25409 ts_tablet_manager.cc:1397] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 03:26:32.535094 25409 raft_consensus.cc:348] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:32.535185 25409 raft_consensus.cc:374] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:26:32.535240 25409 raft_consensus.cc:729] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72e69a94821b4ca6ac6cd3ff35a768ca, State: Initialized, Role: FOLLOWER
I20260809 03:26:32.535287 25409 consensus_queue.cc:260] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:32.535385 25409 ts_tablet_manager.cc:1428] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:32.535408 25539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.531519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:33923 (local address 127.0.0.1:47704)
0809 03:26:32.531623 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:32.531633 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:32.531664 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:32.531977 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:26:32.531978 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:26:32.531980 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:26:32.532020 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:32.532021 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.533183 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.533184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:32.534102 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:32.534104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.535183 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.535184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:32.535248 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.535252 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:26:32.535286 (+ 34us) client_negotiation.cc:240] Negotiation successful
0809 03:26:32.535334 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88,"mutex_wait_us":21}
I20260809 03:26:32.535633 25834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.531553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:35865 (local address 127.0.0.1:60304)
0809 03:26:32.531824 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:32.531837 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:32.531886 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:32.532124 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:26:32.532125 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:26:32.532129 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:26:32.532162 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:32.532162 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.533336 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.533337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:32.534422 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:32.534424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.535374 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.535375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:32.535443 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.535447 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:26:32.535508 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 03:26:32.535545 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":107,"threads_started":1}
I20260809 03:26:32.535795 25835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.531632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47704 (local address 127.8.5.194:33923)
0809 03:26:32.531814 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:32.531819 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:32.531830 (+ 11us) server_negotiation.cc:407] Connection header received
0809 03:26:32.531880 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:32.531882 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:32.531897 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:32.531986 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:26:32.532076 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.533091 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.534234 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.535083 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.535551 (+ 468us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.535617 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:32.535647 (+ 30us) server_negotiation.cc:299] Negotiation successful
0809 03:26:32.535695 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":92,"threads_started":1}
I20260809 03:26:32.535848 25836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.531645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60304 (local address 127.8.5.195:35865)
0809 03:26:32.531897 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:32.531902 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:32.531911 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:26:32.531947 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:32.531949 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:32.531965 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:32.532040 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:26:32.532234 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.533250 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.534515 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.535268 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.535371 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.535436 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:32.535734 (+ 298us) server_negotiation.cc:299] Negotiation successful
0809 03:26:32.535776 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":85,"threads_started":1}
I20260809 03:26:32.536453 25609 tablet_service.cc:1467] Processing CreateTablet for tablet ee03419d107d4b22aaa8c2cf962a9386 (DEFAULT_TABLE table=test-table [id=72d048b276784c82ad7453d7be18c2da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:26:32.536453 25751 tablet_service.cc:1467] Processing CreateTablet for tablet ee03419d107d4b22aaa8c2cf962a9386 (DEFAULT_TABLE table=test-table [id=72d048b276784c82ad7453d7be18c2da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:26:32.536788 25751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee03419d107d4b22aaa8c2cf962a9386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:26:32.536788 25609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee03419d107d4b22aaa8c2cf962a9386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:26:32.540266 25840 tablet_bootstrap.cc:492] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7: Bootstrap starting.
I20260809 03:26:32.540843 25840 tablet_bootstrap.cc:654] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7: Neither blocks nor log segments found. Creating new log.
I20260809 03:26:32.541296 25840 log.cc:824] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7: Log is configured to *not* fsync() on all Append() calls
I20260809 03:26:32.541560 25839 tablet_bootstrap.cc:492] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef: Bootstrap starting.
I20260809 03:26:32.541994 25840 tablet_bootstrap.cc:492] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7: No bootstrap required, opened a new log
I20260809 03:26:32.542048 25840 ts_tablet_manager.cc:1397] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:26:32.542130 25839 tablet_bootstrap.cc:654] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef: Neither blocks nor log segments found. Creating new log.
I20260809 03:26:32.542627 25839 log.cc:824] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef: Log is configured to *not* fsync() on all Append() calls
I20260809 03:26:32.543497 25839 tablet_bootstrap.cc:492] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef: No bootstrap required, opened a new log
I20260809 03:26:32.543610 25839 ts_tablet_manager.cc:1397] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:26:32.543928 25840 raft_consensus.cc:348] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:32.544103 25840 raft_consensus.cc:374] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:26:32.544139 25840 raft_consensus.cc:729] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a6cdb0a39e24635886f38345de09aa7, State: Initialized, Role: FOLLOWER
I20260809 03:26:32.544299 25840 consensus_queue.cc:260] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:32.544582 25840 ts_tablet_manager.cc:1428] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 03:26:32.544620 25680 heartbeater.cc:503] Master 127.8.5.254:38695 was elected leader, sending a full tablet report...
I20260809 03:26:32.545563 25839 raft_consensus.cc:348] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:32.545720 25839 raft_consensus.cc:374] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:26:32.545753 25839 raft_consensus.cc:729] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b762adb0131d4a38be7ce7537d7566ef, State: Initialized, Role: FOLLOWER
I20260809 03:26:32.545826 25839 consensus_queue.cc:260] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:32.546013 25839 ts_tablet_manager.cc:1428] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:26:32.546066 25828 heartbeater.cc:503] Master 127.8.5.254:38695 was elected leader, sending a full tablet report...
W20260809 03:26:32.621575 25681 tablet.cc:2369] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:26:32.640211 25844 raft_consensus.cc:482] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:26:32.640363 25844 raft_consensus.cc:504] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:32.640740 25844 leader_election.cc:288] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b762adb0131d4a38be7ce7537d7566ef (127.8.5.195:35865), 72e69a94821b4ca6ac6cd3ff35a768ca (127.8.5.193:33891)
I20260809 03:26:32.643663 25540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.641022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:56831 (local address 127.8.5.193:33891)
0809 03:26:32.641092 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:32.641095 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:32.641105 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:26:32.641139 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:32.641140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:32.641152 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:32.641233 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:26:32.641414 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.641897 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.642858 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.643303 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.643388 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.643398 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:32.643560 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 03:26:32.643599 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 03:26:32.643663 25682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.640955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:33891 (local address 127.8.5.194:56831)
0809 03:26:32.641023 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:32.641034 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:32.641078 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:32.641258 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:26:32.641259 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:26:32.641262 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:26:32.641342 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:32.641344 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.641981 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.641982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:32.642759 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:32.642761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.643389 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.643390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:32.643474 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.643476 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:26:32.643553 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 03:26:32.643591 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 03:26:32.643808 25836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.641082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:42107 (local address 127.8.5.195:35865)
0809 03:26:32.641129 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:32.641131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:32.641303 (+ 172us) server_negotiation.cc:407] Connection header received
0809 03:26:32.641368 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:32.641369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:32.641389 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:32.641449 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:26:32.641597 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.642052 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.643068 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.643440 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.643524 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.643533 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:32.643696 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 03:26:32.643732 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 03:26:32.643821 25846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.640955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:35865 (local address 127.8.5.194:42107)
0809 03:26:32.641223 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:32.641232 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:32.641308 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:32.641451 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:26:32.641452 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:26:32.641453 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:26:32.641523 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:32.641526 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.642136 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.642137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:32.642928 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:32.642930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.643527 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.643528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:32.643610 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.643613 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:26:32.643688 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 03:26:32.643725 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":99,"thread_start_us":125,"threads_started":1}
I20260809 03:26:32.644006 25477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee03419d107d4b22aaa8c2cf962a9386" candidate_uuid: "8a6cdb0a39e24635886f38345de09aa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" is_pre_election: true
I20260809 03:26:32.644181 25477 raft_consensus.cc:2454] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a6cdb0a39e24635886f38345de09aa7 in term 0.
I20260809 03:26:32.644287 25775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee03419d107d4b22aaa8c2cf962a9386" candidate_uuid: "8a6cdb0a39e24635886f38345de09aa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b762adb0131d4a38be7ce7537d7566ef" is_pre_election: true
I20260809 03:26:32.644451 25775 raft_consensus.cc:2454] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a6cdb0a39e24635886f38345de09aa7 in term 0.
I20260809 03:26:32.644429 25560 leader_election.cc:302] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72e69a94821b4ca6ac6cd3ff35a768ca, 8a6cdb0a39e24635886f38345de09aa7; no voters:
I20260809 03:26:32.644580 25844 raft_consensus.cc:2781] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:26:32.644645 25844 raft_consensus.cc:482] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:26:32.644680 25844 raft_consensus.cc:3037] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:26:32.647147 25844 raft_consensus.cc:504] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:32.647305 25844 leader_election.cc:288] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [CANDIDATE]: Term 1 election: Requested vote from peers b762adb0131d4a38be7ce7537d7566ef (127.8.5.195:35865), 72e69a94821b4ca6ac6cd3ff35a768ca (127.8.5.193:33891)
I20260809 03:26:32.647485 25477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee03419d107d4b22aaa8c2cf962a9386" candidate_uuid: "8a6cdb0a39e24635886f38345de09aa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca"
I20260809 03:26:32.647486 25775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee03419d107d4b22aaa8c2cf962a9386" candidate_uuid: "8a6cdb0a39e24635886f38345de09aa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b762adb0131d4a38be7ce7537d7566ef"
I20260809 03:26:32.647574 25477 raft_consensus.cc:3037] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:26:32.647622 25775 raft_consensus.cc:3037] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:26:32.648517 25775 raft_consensus.cc:2454] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a6cdb0a39e24635886f38345de09aa7 in term 1.
I20260809 03:26:32.648730 25558 leader_election.cc:302] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a6cdb0a39e24635886f38345de09aa7, b762adb0131d4a38be7ce7537d7566ef; no voters:
I20260809 03:26:32.648826 25844 raft_consensus.cc:2781] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:26:32.648872 25477 raft_consensus.cc:2454] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a6cdb0a39e24635886f38345de09aa7 in term 1.
I20260809 03:26:32.648984 25844 raft_consensus.cc:686] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [term 1 LEADER]: Becoming Leader. State: Replica: 8a6cdb0a39e24635886f38345de09aa7, State: Running, Role: LEADER
I20260809 03:26:32.649112 25844 consensus_queue.cc:237] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:32.649971 25321 catalog_manager.cc:5495] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a6cdb0a39e24635886f38345de09aa7 (127.8.5.194). New cstate: current_term: 1 leader_uuid: "8a6cdb0a39e24635886f38345de09aa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } health_report { overall_health: UNKNOWN } } }
I20260809 03:26:32.679579 25835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.677151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47714 (local address 127.8.5.194:33923)
0809 03:26:32.677227 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:32.677229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:32.677242 (+ 13us) server_negotiation.cc:407] Connection header received
0809 03:26:32.677282 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:32.677283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:32.677303 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:32.677374 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:26:32.677495 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.677954 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.678694 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:32.678914 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:32.679062 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:32.679268 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:26:32.679376 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:26:32.679441 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:32.679483 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 03:26:32.679501 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 03:26:32.681522 25775 raft_consensus.cc:1261] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef [term 1 FOLLOWER]: Refusing update from remote peer 8a6cdb0a39e24635886f38345de09aa7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:26:32.681555 25477 raft_consensus.cc:1261] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Refusing update from remote peer 8a6cdb0a39e24635886f38345de09aa7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:26:32.681915 25847 consensus_queue.cc:1035] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:26:32.682057 25844 consensus_queue.cc:1035] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:26:32.685042 25851 mvcc.cc:205] Tried to move back new op lower bound from 7316463586020724736 to 7316463585891409920. Current Snapshot: MvccSnapshot[applied={T|T < 7316463586020724736}]
I20260809 03:26:32.685209 25852 mvcc.cc:205] Tried to move back new op lower bound from 7316463586020724736 to 7316463585891409920. Current Snapshot: MvccSnapshot[applied={T|T < 7316463586020724736}]
I20260809 03:26:32.686866 25320 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50826:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:26:32.686986 25320 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50826:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:26:32.687783 25320 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: Sending DeleteTablet for 3 replicas of tablet ee03419d107d4b22aaa8c2cf962a9386
I20260809 03:26:32.688117 25454 tablet_service.cc:1514] Processing DeleteTablet for tablet ee03419d107d4b22aaa8c2cf962a9386 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:26:32 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:56586
I20260809 03:26:32.688125 25751 tablet_service.cc:1514] Processing DeleteTablet for tablet ee03419d107d4b22aaa8c2cf962a9386 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:26:32 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:60304
I20260809 03:26:32.688215 25541 tablet_replica.cc:330] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca: stopping tablet replica
I20260809 03:26:32.688267 25541 raft_consensus.cc:2229] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:26:32.688251 25609 tablet_service.cc:1514] Processing DeleteTablet for tablet ee03419d107d4b22aaa8c2cf962a9386 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:26:32 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:47704
I20260809 03:26:32.688330 25541 raft_consensus.cc:2258] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:26:32.688369 25859 tablet_replica.cc:330] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef: stopping tablet replica
I20260809 03:26:32.688438 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 25361
I20260809 03:26:32.688468 25859 raft_consensus.cc:2229] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:26:32.688562 25859 raft_consensus.cc:2258] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:26:32.691840 25859 ts_tablet_manager.cc:1905] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:26:32.693836 25859 ts_tablet_manager.cc:1918] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:26:32.693945 25859 log.cc:1196] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/ee03419d107d4b22aaa8c2cf962a9386
I20260809 03:26:32.694272 25859 ts_tablet_manager.cc:1939] T ee03419d107d4b22aaa8c2cf962a9386 P b762adb0131d4a38be7ce7537d7566ef: Deleting consensus metadata
I20260809 03:26:32.694710 25860 tablet_replica.cc:330] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7: stopping tablet replica
I20260809 03:26:32.694777 25303 catalog_manager.cc:4841] TS b762adb0131d4a38be7ce7537d7566ef (127.8.5.195:35865): tablet ee03419d107d4b22aaa8c2cf962a9386 (table test-table [id=72d048b276784c82ad7453d7be18c2da]) successfully deleted
I20260809 03:26:32.694866 25860 raft_consensus.cc:2229] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:26:32.695034 25860 raft_consensus.cc:2258] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:26:32.695451 25860 ts_tablet_manager.cc:1905] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:26:32.696972 25860 ts_tablet_manager.cc:1918] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:26:32.697067 25860 log.cc:1196] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/ee03419d107d4b22aaa8c2cf962a9386
I20260809 03:26:32.697360 25860 ts_tablet_manager.cc:1939] T ee03419d107d4b22aaa8c2cf962a9386 P 8a6cdb0a39e24635886f38345de09aa7: Deleting consensus metadata
I20260809 03:26:32.697755 25305 catalog_manager.cc:4841] TS 8a6cdb0a39e24635886f38345de09aa7 (127.8.5.194:33923): tablet ee03419d107d4b22aaa8c2cf962a9386 (table test-table [id=72d048b276784c82ad7453d7be18c2da]) successfully deleted
W20260809 03:26:32.698911 25305 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.5.193:33891 (error 108)
I20260809 03:26:32.699327 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 25536
I20260809 03:26:32.699448 25834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:32.699284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:33891 (local address 127.0.0.1:56600)
0809 03:26:32.699343 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:32.699408 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.193:33891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 03:26:32.701165 25305 catalog_manager.cc:4584] TS 72e69a94821b4ca6ac6cd3ff35a768ca (127.8.5.193:33891): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ee03419d107d4b22aaa8c2cf962a9386: Network error: Client connection negotiation failed: client connection to 127.8.5.193:33891: connect: Connection refused (error 111)
I20260809 03:26:32.705389 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 25684
I20260809 03:26:32.711345 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 25286
I20260809 03:26:52.719209 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:38695
--webserver_interface=127.8.5.254
--webserver_port=40011
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:38695
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:26:52.801036 25862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:26:52.801273 25862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:26:52.801313 25862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:26:52.802457 25862 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 03:26:52.802522 25862 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 03:26:52.802544 25862 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 03:26:52.802562 25862 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:26:52.802596 25862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:26:52.802626 25862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:26:52.802657 25862 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:26:52.802685 25862 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:26:52.804318 25862 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:38695
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:38695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=40011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25862
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:26:52.804579 25862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:26:52.804809 25862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:26:52.810222 25868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:26:52.810246 25867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:26:52.810359 25862 server_base.cc:1034] running on GCE node
W20260809 03:26:52.810223 25870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:26:52.810670 25862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:26:52.810972 25862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:26:52.812172 25862 hybrid_clock.cc:648] HybridClock initialized: now 1786246012812168 us; error 34 us; skew 500 ppm
Aug 09 03:26:52 dist-test-slave-2w3w krb5kdc[24679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246012, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:26:52.814688 25862 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:26:52.815199 25862 webserver.cc:460] Webserver started at http://127.8.5.254:40011/ using document root <none> and password file <none>
I20260809 03:26:52.815450 25862 fs_manager.cc:359] Metadata directory not provided
I20260809 03:26:52.815521 25862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:26:52.816841 25862 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:26:52.817488 25878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:52.817658 25862 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:26:52.817760 25862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "8a6fcf503d04472b8510635ce8d94c52"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "08820c93fc936668b389a94c267f2082"
server_key_iv: "94503ce873be750228b4647c1f854040"
server_key_version: "encryptionkey@0"
I20260809 03:26:52.818084 25862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:26:52.837571 25862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:26:52.840022 25862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:26:52.840185 25862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:26:52.844345 25862 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:38695
I20260809 03:26:52.844383 25936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:38695 every 8 connection(s)
I20260809 03:26:52.844863 25862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:26:52.845014 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 25862
I20260809 03:26:52.845389 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:33891
--local_ip_for_outbound_sockets=127.8.5.193
--tserver_master_addrs=127.8.5.254:38695
--webserver_port=38573
--webserver_interface=127.8.5.193
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 03:26:52.847107 25937 sys_catalog.cc:263] Verifying existing consensus state
I20260809 03:26:52.847869 25937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: Bootstrap starting.
I20260809 03:26:52.857091 25937 log.cc:824] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: Log is configured to *not* fsync() on all Append() calls
I20260809 03:26:52.859498 25937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 03:26:52.859834 25937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: Bootstrap complete.
I20260809 03:26:52.862138 25937 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a6fcf503d04472b8510635ce8d94c52" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38695 } }
I20260809 03:26:52.862349 25937 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a6fcf503d04472b8510635ce8d94c52, State: Initialized, Role: FOLLOWER
I20260809 03:26:52.862515 25937 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a6fcf503d04472b8510635ce8d94c52" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38695 } }
I20260809 03:26:52.862577 25937 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:26:52.862623 25937 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:26:52.862669 25937 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 2 FOLLOWER]: Advancing to term 3
I20260809 03:26:52.863713 25937 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a6fcf503d04472b8510635ce8d94c52" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38695 } }
I20260809 03:26:52.863806 25937 leader_election.cc:302] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a6fcf503d04472b8510635ce8d94c52; no voters:
I20260809 03:26:52.864028 25937 leader_election.cc:288] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 03:26:52.864065 25941 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 03:26:52.864233 25941 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [term 3 LEADER]: Becoming Leader. State: Replica: 8a6fcf503d04472b8510635ce8d94c52, State: Running, Role: LEADER
I20260809 03:26:52.864300 25937 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:26:52.864434 25941 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a6fcf503d04472b8510635ce8d94c52" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38695 } }
I20260809 03:26:52.864745 25941 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a6fcf503d04472b8510635ce8d94c52. Latest consensus state: current_term: 3 leader_uuid: "8a6fcf503d04472b8510635ce8d94c52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a6fcf503d04472b8510635ce8d94c52" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38695 } } }
I20260809 03:26:52.864845 25941 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [sys.catalog]: This master's current role is: LEADER
I20260809 03:26:52.865208 25951 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:26:52.864748 25943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "8a6fcf503d04472b8510635ce8d94c52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a6fcf503d04472b8510635ce8d94c52" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38695 } } }
I20260809 03:26:52.865410 25943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52 [sys.catalog]: This master's current role is: LEADER
I20260809 03:26:52.866206 25951 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:26:52.866501 25951 catalog_manager.cc:1259] Loaded cluster ID: 738b471f162a423fad7cff1e25189ada
I20260809 03:26:52.866545 25951 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:26:52.867547 25951 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:26:52.867738 25951 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: Loaded TSK: 0
I20260809 03:26:52.867798 25951 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8a6fcf503d04472b8510635ce8d94c52: Loaded TSK: 1
F20260809 03:26:52.868029 25951 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fd92be179ad google::LogMessage::Fail() at ??:0
@ 0x7fd92be1a88a google::LogMessage::SendToLog() at ??:0
@ 0x7fd92be174de google::LogMessage::Flush() at ??:0
@ 0x7fd92be18a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fd92e584104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fd92e581d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fd933d711cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fd933d7148e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fd933d71594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fd933d37c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fd933d41ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fd92dce50d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fd92dcda954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fd92eb3e6db start_thread at ??:0
@ 0x7fd92a91561f clone at ??:0
W20260809 03:26:52.947894 25939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:26:52.948081 25939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:26:52.948103 25939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:26:52.949273 25939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:26:52.949311 25939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:26:52.949339 25939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:26:52.950747 25939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:33891
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=38573
--tserver_master_addrs=127.8.5.254:38695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25939
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:26:52.950969 25939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:26:52.951262 25939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:26:52.956372 25982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:26:52.956465 25939 server_base.cc:1034] running on GCE node
W20260809 03:26:52.956380 25986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:26:52.956677 25984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:26:52.956938 25939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:26:52.957187 25939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:26:52.958359 25939 hybrid_clock.cc:648] HybridClock initialized: now 1786246012958338 us; error 45 us; skew 500 ppm
Aug 09 03:26:52 dist-test-slave-2w3w krb5kdc[24679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246012, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:26:52.961000 25939 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:26:52.961501 25939 webserver.cc:460] Webserver started at http://127.8.5.193:38573/ using document root <none> and password file <none>
I20260809 03:26:52.961750 25939 fs_manager.cc:359] Metadata directory not provided
I20260809 03:26:52.961825 25939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:26:52.963255 25939 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:26:52.963969 25993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:52.964161 25939 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:26:52.964227 25939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "72e69a94821b4ca6ac6cd3ff35a768ca"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "f1faf53492f2ecd2d75bd35a90bd687f"
server_key_iv: "d9c82fa11a6c1a37b3d765a594d3a003"
server_key_version: "encryptionkey@0"
I20260809 03:26:52.964576 25939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:26:52.982210 25939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:26:52.984547 25939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:26:52.984687 25939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:26:52.984949 25939 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:26:52.985419 26001 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 03:26:52.986843 25939 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 03:26:52.986897 25939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 03:26:52.986922 25939 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 03:26:52.987598 25939 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 03:26:52.987643 25939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 03:26:52.987686 26001 tablet_bootstrap.cc:492] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca: Bootstrap starting.
I20260809 03:26:52.995275 25939 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:33891
I20260809 03:26:52.995646 25939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:26:52.999063 26001 log.cc:824] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca: Log is configured to *not* fsync() on all Append() calls
I20260809 03:26:52.999085 26118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:33891 every 8 connection(s)
I20260809 03:26:53.001575 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 25939
I20260809 03:26:53.001729 26001 tablet_bootstrap.cc:492] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 03:26:53.001902 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:33923
--local_ip_for_outbound_sockets=127.8.5.194
--tserver_master_addrs=127.8.5.254:38695
--webserver_port=43697
--webserver_interface=127.8.5.194
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 03:26:53.002074 26001 tablet_bootstrap.cc:492] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca: Bootstrap complete.
I20260809 03:26:53.003383 26001 ts_tablet_manager.cc:1397] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.008s
I20260809 03:26:53.004796 26001 raft_consensus.cc:348] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:53.005112 26001 raft_consensus.cc:729] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72e69a94821b4ca6ac6cd3ff35a768ca, State: Initialized, Role: FOLLOWER
I20260809 03:26:53.005271 26001 consensus_queue.cc:260] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:53.005550 26001 ts_tablet_manager.cc:1428] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
W20260809 03:26:53.087353 26121 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:26:52.996270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:58383)
0809 03:26:52.996451 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:52.996495 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:52.996928 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:53.087140 (+ 90212us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":114,"threads_started":1}
W20260809 03:26:53.087616 26119 heartbeater.cc:644] Failed to heartbeat to 127.8.5.254:38695 (0 consecutive failures): Network error: Failed to ping master at 127.8.5.254:38695: Client connection negotiation failed: client connection to 127.8.5.254:38695: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 03:26:53.087998 26121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:53.087885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:44743)
0809 03:26:53.087940 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:53.087979 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 03:26:53.088392 26121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:53.088271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:58147)
0809 03:26:53.088328 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:53.088363 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 03:26:53.088534 26119 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 03:26:53.096762 26123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:26:53.096952 26123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:26:53.096975 26123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:26:53.098120 26123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:26:53.098160 26123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:26:53.098186 26123 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:26:53.099668 26123 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:33923
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=43697
--tserver_master_addrs=127.8.5.254:38695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26123
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:26:53.099905 26123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:26:53.100153 26123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:26:53.105319 26131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:26:53.105242 26133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:26:53.105330 26123 server_base.cc:1034] running on GCE node
W20260809 03:26:53.105242 26129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:26:53.105654 26123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:26:53.105870 26123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:26:53.107021 26123 hybrid_clock.cc:648] HybridClock initialized: now 1786246013106998 us; error 41 us; skew 500 ppm
Aug 09 03:26:53 dist-test-slave-2w3w krb5kdc[24679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246013, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:26:53.109478 26123 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:26:53.109846 26123 webserver.cc:460] Webserver started at http://127.8.5.194:43697/ using document root <none> and password file <none>
I20260809 03:26:53.110033 26123 fs_manager.cc:359] Metadata directory not provided
I20260809 03:26:53.110073 26123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:26:53.111400 26123 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:26:53.111981 26140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:53.112155 26123 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:26:53.112255 26123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "8a6cdb0a39e24635886f38345de09aa7"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "d0b0d1713aebb60d718d14e0f96de50c"
server_key_iv: "ee26b2e1c14ab4be55c865b97b34a0f9"
server_key_version: "encryptionkey@0"
I20260809 03:26:53.112583 26123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:26:53.125782 26123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:26:53.127493 26123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:26:53.127645 26123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:26:53.127851 26123 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:26:53.128137 26123 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:26:53.128190 26123 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:53.128229 26123 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:26:53.128257 26123 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:53.134117 26123 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:33923
I20260809 03:26:53.134161 26261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:33923 every 8 connection(s)
I20260809 03:26:53.134473 26123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:26:53.135474 26264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:53.135091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:49401)
0809 03:26:53.135247 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:53.135336 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":76,"threads_started":1}
W20260809 03:26:53.135885 26262 heartbeater.cc:644] Failed to heartbeat to 127.8.5.254:38695 (0 consecutive failures): Network error: Failed to ping master at 127.8.5.254:38695: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
I20260809 03:26:53.136157 26264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:53.136069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:51639)
0809 03:26:53.136114 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:53.136139 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260809 03:26:53.136493 26264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:53.136373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:57315)
0809 03:26:53.136441 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:53.136472 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 03:26:53.136642 26262 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 03:26:53.140794 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 26123
I20260809 03:26:53.141062 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:35865
--local_ip_for_outbound_sockets=127.8.5.195
--tserver_master_addrs=127.8.5.254:38695
--webserver_port=46487
--webserver_interface=127.8.5.195
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:39135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:26:53.221583 26265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:26:53.221767 26265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:26:53.221791 26265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:26:53.222939 26265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:26:53.223002 26265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:26:53.223029 26265 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:26:53.224439 26265 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:39135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:35865
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=46487
--tserver_master_addrs=127.8.5.254:38695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26265
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:26:53.224651 26265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:26:53.224902 26265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:26:53.229794 26271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:26:53.229836 26272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:26:53.229770 26276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:26:53.230098 26265 server_base.cc:1034] running on GCE node
I20260809 03:26:53.230327 26265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:26:53.230556 26265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:26:53.231698 26265 hybrid_clock.cc:648] HybridClock initialized: now 1786246013231669 us; error 48 us; skew 500 ppm
Aug 09 03:26:53 dist-test-slave-2w3w krb5kdc[24679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246013, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:26:53.234233 26265 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:26:53.234669 26265 webserver.cc:460] Webserver started at http://127.8.5.195:46487/ using document root <none> and password file <none>
I20260809 03:26:53.234949 26265 fs_manager.cc:359] Metadata directory not provided
I20260809 03:26:53.235049 26265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:26:53.236352 26265 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:26:53.236964 26283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:53.237152 26265 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:26:53.237216 26265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "b762adb0131d4a38be7ce7537d7566ef"
format_stamp: "Formatted at 2026-08-09 03:26:11 on dist-test-slave-2w3w"
server_key: "28f15b8b7ec3156454450daa9da69b6d"
server_key_iv: "ed4f153cc691afac8c678a0d74ecbd47"
server_key_version: "encryptionkey@0"
I20260809 03:26:53.237537 26265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:26:53.246202 26265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:26:53.248423 26265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:26:53.248579 26265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:26:53.248799 26265 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:26:53.249094 26265 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:26:53.249130 26265 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:53.249148 26265 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:26:53.249161 26265 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:26:53.255450 26265 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:35865
I20260809 03:26:53.255504 26410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:35865 every 8 connection(s)
I20260809 03:26:53.255839 26265 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:26:53.256385 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 26265
I20260809 03:26:53.256842 26413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:53.256456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:33829)
0809 03:26:53.256605 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:53.256688 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":85,"threads_started":1}
W20260809 03:26:53.257253 26411 heartbeater.cc:644] Failed to heartbeat to 127.8.5.254:38695 (0 consecutive failures): Network error: Failed to ping master at 127.8.5.254:38695: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
I20260809 03:26:53.257512 26413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:53.257436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:51663)
0809 03:26:53.257468 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:53.257490 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260809 03:26:53.257805 26413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:53.257715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:51157)
0809 03:26:53.257761 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:53.257784 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 03:26:53.257915 26411 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 03:26:54.089116 26415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:54.088888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:35447)
0809 03:26:54.089010 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:54.089045 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":65,"threads_started":1}
I20260809 03:26:54.137123 26416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:54.136934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:36103)
0809 03:26:54.137040 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:54.137073 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":58,"threads_started":1}
I20260809 03:26:54.237124 26417 raft_consensus.cc:482] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:26:54.237242 26417 raft_consensus.cc:504] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:54.237577 26417 leader_election.cc:288] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a6cdb0a39e24635886f38345de09aa7 (127.8.5.194:33923), b762adb0131d4a38be7ce7537d7566ef (127.8.5.195:35865)
Aug 09 03:26:54 dist-test-slave-2w3w krb5kdc[24679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246012, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.195@KRBTEST.COM
Aug 09 03:26:54 dist-test-slave-2w3w krb5kdc[24679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246012, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.194@KRBTEST.COM
I20260809 03:26:54.248760 26419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:54.237797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:38565 (local address 127.8.5.194:33923)
0809 03:26:54.238584 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:54.238594 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:54.238656 (+ 62us) server_negotiation.cc:407] Connection header received
0809 03:26:54.239313 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:54.239316 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:54.239364 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:54.239518 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:26:54.240083 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:54.240977 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:54.242031 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:54.242574 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:54.242683 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:54.245492 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:26:54.245496 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:26:54.245496 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:26:54.245508 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:26:54.247160 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:54.247567 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:54.247573 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:54.247574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:54.247651 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:54.247902 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:54.247902 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:54.247903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:54.248134 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:26:54.248219 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:54.248503 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 03:26:54.248638 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":85,"threads_started":1}
I20260809 03:26:54.248764 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:54.237904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:56101 (local address 127.8.5.195:35865)
0809 03:26:54.238147 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0809 03:26:54.238162 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 03:26:54.238190 (+ 28us) server_negotiation.cc:407] Connection header received
0809 03:26:54.238919 (+ 729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:26:54.238923 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:26:54.239036 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:26:54.239195 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:26:54.240050 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:54.240994 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:54.242004 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:26:54.242585 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:26:54.242704 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:54.245077 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:26:54.245081 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:26:54.245081 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:26:54.245090 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:26:54.247032 (+ 1942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:54.247534 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:54.247537 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:54.247537 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:54.247641 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:26:54.247882 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:26:54.247883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:26:54.247883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:26:54.248133 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:26:54.248222 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 03:26:54.248519 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 03:26:54.248651 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":59,"threads_started":1}
I20260809 03:26:54.248860 26418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:54.237808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:35865 (local address 127.8.5.193:56101)
0809 03:26:54.237919 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:54.237932 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:54.237998 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:54.239265 (+ 1267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:26:54.239269 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:26:54.239742 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:26:54.239936 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:54.239942 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:54.241108 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:54.241109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:54.241924 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:54.241926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:54.242681 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:54.242682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:54.242777 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:54.243434 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:26:54.243443 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:26:54.244963 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:26:54.247106 (+ 2143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:26:54.247113 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:26:54.247115 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:26:54.247460 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:26:54.247705 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:26:54.247706 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:26:54.247706 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:26:54.247818 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:26:54.248207 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:26:54.248213 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:26:54.248365 (+ 152us) client_negotiation.cc:769] Sending connection context
0809 03:26:54.248446 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 03:26:54.248736 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"mutex_wait_us":164,"thread_start_us":67,"threads_started":1}
I20260809 03:26:54.249509 26415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:54.237718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:33923 (local address 127.8.5.193:38565)
0809 03:26:54.237950 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:54.237961 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:26:54.238020 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:26:54.239505 (+ 1485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:26:54.239506 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:26:54.239743 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:26:54.239936 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:54.239942 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:54.241075 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:54.241076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:54.241926 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:26:54.241928 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:26:54.242657 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:26:54.242658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:26:54.242777 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:26:54.243500 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:26:54.243509 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:26:54.245386 (+ 1877us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:26:54.247250 (+ 1864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:26:54.247251 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:26:54.247251 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:26:54.247478 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:26:54.247731 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:26:54.247732 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:26:54.247732 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:26:54.247821 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:26:54.248214 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:26:54.248215 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:26:54.248343 (+ 128us) client_negotiation.cc:769] Sending connection context
0809 03:26:54.248439 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 03:26:54.248688 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":75}
W20260809 03:26:54.250083 25994 leader_election.cc:341] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b762adb0131d4a38be7ce7537d7566ef (127.8.5.195:35865): Not found: Tablet not found: ee03419d107d4b22aaa8c2cf962a9386
W20260809 03:26:54.250172 25997 leader_election.cc:341] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8a6cdb0a39e24635886f38345de09aa7 (127.8.5.194:33923): Not found: Tablet not found: ee03419d107d4b22aaa8c2cf962a9386
I20260809 03:26:54.250240 25997 leader_election.cc:302] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72e69a94821b4ca6ac6cd3ff35a768ca; no voters: 8a6cdb0a39e24635886f38345de09aa7, b762adb0131d4a38be7ce7537d7566ef
I20260809 03:26:54.250360 26417 raft_consensus.cc:2726] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 03:26:54.258363 26421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:54.258188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:56079)
0809 03:26:54.258295 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:54.258334 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":61,"threads_started":1}
I20260809 03:26:55.089849 26422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:55.089588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:35773)
0809 03:26:55.089738 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:55.089775 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":77,"threads_started":1}
I20260809 03:26:55.137684 26423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:55.137480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:35193)
0809 03:26:55.137599 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:55.137645 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":59,"threads_started":1}
I20260809 03:26:55.258919 26424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:55.258722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:47565)
0809 03:26:55.258846 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:55.258882 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":62,"threads_started":1}
I20260809 03:26:56.090564 26425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:56.090336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:35887)
0809 03:26:56.090475 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:56.090514 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":81,"threads_started":1}
I20260809 03:26:56.138376 26426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:56.138145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:56731)
0809 03:26:56.138293 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:56.138333 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":66,"threads_started":1}
I20260809 03:26:56.259564 26427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:56.259354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:34665)
0809 03:26:56.259482 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:56.259523 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":61,"threads_started":1}
I20260809 03:26:56.308086 26428 raft_consensus.cc:482] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:26:56.308176 26428 raft_consensus.cc:504] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:56.308388 26428 leader_election.cc:288] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a6cdb0a39e24635886f38345de09aa7 (127.8.5.194:33923), b762adb0131d4a38be7ce7537d7566ef (127.8.5.195:35865)
W20260809 03:26:56.308822 25994 leader_election.cc:341] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b762adb0131d4a38be7ce7537d7566ef (127.8.5.195:35865): Not found: Tablet not found: ee03419d107d4b22aaa8c2cf962a9386
W20260809 03:26:56.308924 25997 leader_election.cc:341] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8a6cdb0a39e24635886f38345de09aa7 (127.8.5.194:33923): Not found: Tablet not found: ee03419d107d4b22aaa8c2cf962a9386
I20260809 03:26:56.308962 25997 leader_election.cc:302] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72e69a94821b4ca6ac6cd3ff35a768ca; no voters: 8a6cdb0a39e24635886f38345de09aa7, b762adb0131d4a38be7ce7537d7566ef
I20260809 03:26:56.309055 26428 raft_consensus.cc:2726] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 03:26:57.091380 26429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:57.091169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:51493)
0809 03:26:57.091293 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:57.091332 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":63,"threads_started":1}
I20260809 03:26:57.139097 26430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:57.138832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:39619)
0809 03:26:57.139009 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:57.139052 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":69,"threads_started":1}
I20260809 03:26:57.260274 26431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:57.260049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:49305)
0809 03:26:57.260186 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:57.260228 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":64,"threads_started":1}
I20260809 03:26:58.092075 26433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:58.091852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:33571)
0809 03:26:58.091992 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:58.092027 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":68,"threads_started":1}
I20260809 03:26:58.139751 26434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:58.139542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:47935)
0809 03:26:58.139673 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:58.139710 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":61,"threads_started":1}
I20260809 03:26:58.261008 26435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:58.260801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:58411)
0809 03:26:58.260929 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:58.260965 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":75,"threads_started":1}
I20260809 03:26:59.092820 26436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:59.092593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:57455)
0809 03:26:59.092733 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:59.092770 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":81,"threads_started":1}
I20260809 03:26:59.140413 26437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:59.140203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:55667)
0809 03:26:59.140337 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:59.140374 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":66,"threads_started":1}
I20260809 03:26:59.261615 26439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:26:59.261418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:33385)
0809 03:26:59.261532 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 03:26:59.261573 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":59,"threads_started":1}
I20260809 03:26:59.426229 26440 raft_consensus.cc:482] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:26:59.426328 26440 raft_consensus.cc:504] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:26:59.426545 26440 leader_election.cc:288] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a6cdb0a39e24635886f38345de09aa7 (127.8.5.194:33923), b762adb0131d4a38be7ce7537d7566ef (127.8.5.195:35865)
W20260809 03:26:59.426995 25997 leader_election.cc:341] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8a6cdb0a39e24635886f38345de09aa7 (127.8.5.194:33923): Not found: Tablet not found: ee03419d107d4b22aaa8c2cf962a9386
W20260809 03:26:59.427068 25994 leader_election.cc:341] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b762adb0131d4a38be7ce7537d7566ef (127.8.5.195:35865): Not found: Tablet not found: ee03419d107d4b22aaa8c2cf962a9386
I20260809 03:26:59.427114 25994 leader_election.cc:302] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72e69a94821b4ca6ac6cd3ff35a768ca; no voters: 8a6cdb0a39e24635886f38345de09aa7, b762adb0131d4a38be7ce7537d7566ef
I20260809 03:26:59.427191 26440 raft_consensus.cc:2726] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 03:27:00.093588 26441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:00.093313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:47339)
0809 03:27:00.093496 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:00.093538 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":105,"threads_started":1}
I20260809 03:27:00.141049 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:00.140861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:53091)
0809 03:27:00.140976 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:00.141008 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":64,"threads_started":1}
I20260809 03:27:00.262255 26443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:00.262056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:55195)
0809 03:27:00.262179 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:00.262215 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
I20260809 03:27:01.094242 26444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:01.094048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:36249)
0809 03:27:01.094164 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:01.094194 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":64,"threads_started":1}
I20260809 03:27:01.141713 26445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:01.141509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:47263)
0809 03:27:01.141632 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:01.141670 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":66,"threads_started":1}
I20260809 03:27:01.263100 26446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:01.262799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:59507)
0809 03:27:01.262949 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:01.263057 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":63,"threads_started":1}
I20260809 03:27:02.094873 26447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:02.094660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:46587)
0809 03:27:02.094786 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:02.094821 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
I20260809 03:27:02.142288 26448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:02.142100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:57385)
0809 03:27:02.142214 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:02.142247 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":61,"threads_started":1}
I20260809 03:27:02.263844 26449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:02.263547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:35345)
0809 03:27:02.263752 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:02.263790 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":90,"threads_started":1}
I20260809 03:27:02.812194 26450 raft_consensus.cc:482] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:27:02.812291 26450 raft_consensus.cc:504] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:27:02.812508 26450 leader_election.cc:288] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a6cdb0a39e24635886f38345de09aa7 (127.8.5.194:33923), b762adb0131d4a38be7ce7537d7566ef (127.8.5.195:35865)
W20260809 03:27:02.812942 25994 leader_election.cc:341] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b762adb0131d4a38be7ce7537d7566ef (127.8.5.195:35865): Not found: Tablet not found: ee03419d107d4b22aaa8c2cf962a9386
W20260809 03:27:02.813023 25997 leader_election.cc:341] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8a6cdb0a39e24635886f38345de09aa7 (127.8.5.194:33923): Not found: Tablet not found: ee03419d107d4b22aaa8c2cf962a9386
I20260809 03:27:02.813071 25997 leader_election.cc:302] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72e69a94821b4ca6ac6cd3ff35a768ca; no voters: 8a6cdb0a39e24635886f38345de09aa7, b762adb0131d4a38be7ce7537d7566ef
I20260809 03:27:02.813153 26450 raft_consensus.cc:2726] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 03:27:03.095561 26451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:03.095330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:58543)
0809 03:27:03.095473 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:03.095510 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":80,"threads_started":1}
I20260809 03:27:03.142935 26452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:03.142708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:38707)
0809 03:27:03.142844 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:03.142878 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":64,"threads_started":1}
I20260809 03:27:03.264590 26453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:03.264399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:50249)
0809 03:27:03.264515 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:03.264549 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":65,"threads_started":1}
I20260809 03:27:04.096364 26454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:04.096123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:47527)
0809 03:27:04.096272 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:04.096311 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":65,"threads_started":1}
I20260809 03:27:04.143657 26455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:04.143448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:60749)
0809 03:27:04.143573 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:04.143613 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
I20260809 03:27:04.265182 26457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:04.264985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:42387)
0809 03:27:04.265109 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:04.265142 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":73,"threads_started":1}
I20260809 03:27:05.097149 26458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:05.096906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:44245)
0809 03:27:05.097065 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:05.097102 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":95,"threads_started":1}
I20260809 03:27:05.144375 26459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:05.144135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:41825)
0809 03:27:05.144289 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:05.144326 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":65,"threads_started":1}
I20260809 03:27:05.265919 26460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:05.265649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:35687)
0809 03:27:05.265812 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:05.265868 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":105,"threads_started":1}
I20260809 03:27:06.097870 26461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:06.097624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:49435)
0809 03:27:06.097776 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:06.097820 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":83,"threads_started":1}
I20260809 03:27:06.145104 26462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:06.144875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:51093)
0809 03:27:06.145015 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:06.145057 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":82,"threads_started":1}
I20260809 03:27:06.266690 26463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:06.266419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:45535)
0809 03:27:06.266599 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:06.266644 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":113,"threads_started":1}
I20260809 03:27:06.432252 26464 raft_consensus.cc:482] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:27:06.432369 26464 raft_consensus.cc:504] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a6cdb0a39e24635886f38345de09aa7" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33923 } } peers { permanent_uuid: "b762adb0131d4a38be7ce7537d7566ef" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35865 } } peers { permanent_uuid: "72e69a94821b4ca6ac6cd3ff35a768ca" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 33891 } }
I20260809 03:27:06.432572 26464 leader_election.cc:288] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a6cdb0a39e24635886f38345de09aa7 (127.8.5.194:33923), b762adb0131d4a38be7ce7537d7566ef (127.8.5.195:35865)
W20260809 03:27:06.432986 25994 leader_election.cc:341] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b762adb0131d4a38be7ce7537d7566ef (127.8.5.195:35865): Not found: Tablet not found: ee03419d107d4b22aaa8c2cf962a9386
W20260809 03:27:06.433073 25997 leader_election.cc:341] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8a6cdb0a39e24635886f38345de09aa7 (127.8.5.194:33923): Not found: Tablet not found: ee03419d107d4b22aaa8c2cf962a9386
I20260809 03:27:06.433147 25997 leader_election.cc:302] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72e69a94821b4ca6ac6cd3ff35a768ca; no voters: 8a6cdb0a39e24635886f38345de09aa7, b762adb0131d4a38be7ce7537d7566ef
I20260809 03:27:06.433226 26464 raft_consensus.cc:2726] T ee03419d107d4b22aaa8c2cf962a9386 P 72e69a94821b4ca6ac6cd3ff35a768ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 03:27:07.098652 26465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:07.098398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:48793)
0809 03:27:07.098572 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:07.098607 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":112,"threads_started":1}
I20260809 03:27:07.145824 26466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:07.145589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:48661)
0809 03:27:07.145739 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:07.145777 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":65,"threads_started":1}
I20260809 03:27:07.267366 26467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:07.267152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:34937)
0809 03:27:07.267282 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:07.267322 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":82,"threads_started":1}
I20260809 03:27:08.099500 26468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:08.099294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.193:40549)
0809 03:27:08.099420 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:08.099454 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":66,"threads_started":1}
I20260809 03:27:08.146538 26469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:08.146348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.194:50101)
0809 03:27:08.146462 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:08.146492 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":62,"threads_started":1}
I20260809 03:27:08.261018 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 25939
I20260809 03:27:08.267994 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 26123
I20260809 03:27:08.268105 26470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:08.267851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38695 (local address 127.8.5.195:51905)
0809 03:27:08.267995 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:08.268037 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.254:38695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":53,"threads_started":1}
I20260809 03:27:08.273921 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 26265
2026-08-09T03:27:08Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58297 ms)
[----------] 30 tests from SecurityITest (230847 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:08 dist-test-slave-2w3w krb5kdc[26473](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:08 dist-test-slave-2w3w krb5kdc[26473](info): set up 2 sockets
Aug 09 03:27:08 dist-test-slave-2w3w krb5kdc[26473](info): commencing operation
krb5kdc: starting...
W20260809 03:27:09.388764 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:09 dist-test-slave-2w3w krb5kdc[26473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:27:09.512096 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:34441
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:38553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:34441
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:09.594352 26486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:09.594568 26486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:09.594594 26486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:09.595855 26486 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:09.595903 26486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:09.595917 26486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:09.595964 26486 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:09.595989 26486 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:09.597465 26486 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:38553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:34441
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:34441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26486
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:09.597718 26486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:09.597954 26486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 03:27:09.603247 26486 server_base.cc:1034] running on GCE node
W20260809 03:27:09.603227 26494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:09.603217 26495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:09.603211 26498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:09.603684 26486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:09.604023 26486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:09.605216 26486 hybrid_clock.cc:648] HybridClock initialized: now 1786246029605204 us; error 44 us; skew 500 ppm
Aug 09 03:27:09 dist-test-slave-2w3w krb5kdc[26473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246029, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:09.607947 26486 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:27:09.608431 26486 webserver.cc:460] Webserver started at http://127.8.5.254:45857/ using document root <none> and password file <none>
I20260809 03:27:09.608664 26486 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:09.608731 26486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:09.608889 26486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:09.609946 26486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "a75a2b7f4b194992a529bbd7c30529d9"
format_stamp: "Formatted at 2026-08-09 03:27:09 on dist-test-slave-2w3w"
server_key: "dc347401de24c90106d7d32084747718"
server_key_iv: "5059a7aaf154dd7dfb0ef2c6e16f080e"
server_key_version: "encryptionkey@0"
I20260809 03:27:09.610306 26486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "a75a2b7f4b194992a529bbd7c30529d9"
format_stamp: "Formatted at 2026-08-09 03:27:09 on dist-test-slave-2w3w"
server_key: "dc347401de24c90106d7d32084747718"
server_key_iv: "5059a7aaf154dd7dfb0ef2c6e16f080e"
server_key_version: "encryptionkey@0"
I20260809 03:27:09.611748 26486 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:27:09.612505 26505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:09.612677 26486 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:27:09.612783 26486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "a75a2b7f4b194992a529bbd7c30529d9"
format_stamp: "Formatted at 2026-08-09 03:27:09 on dist-test-slave-2w3w"
server_key: "dc347401de24c90106d7d32084747718"
server_key_iv: "5059a7aaf154dd7dfb0ef2c6e16f080e"
server_key_version: "encryptionkey@0"
I20260809 03:27:09.612882 26486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:09.624900 26486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:09.626724 26486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:09.626889 26486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:09.631263 26486 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:34441
I20260809 03:27:09.631316 26560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:34441 every 8 connection(s)
I20260809 03:27:09.631685 26486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:09.632540 26562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:09.634807 26562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9: Bootstrap starting.
I20260809 03:27:09.635438 26562 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:09.635737 26562 log.cc:824] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:09.636438 26562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9: No bootstrap required, opened a new log
I20260809 03:27:09.637326 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 26486
I20260809 03:27:09.637444 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:09.637641 8215 external_mini_cluster.cc:1428] Setting key f61e5e2bf40ee32b2cfdf90aae5e5d32
I20260809 03:27:09.638686 26562 raft_consensus.cc:348] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a75a2b7f4b194992a529bbd7c30529d9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 34441 } }
I20260809 03:27:09.638875 26562 raft_consensus.cc:374] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:09.638918 26562 raft_consensus.cc:729] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a75a2b7f4b194992a529bbd7c30529d9, State: Initialized, Role: FOLLOWER
I20260809 03:27:09.639081 26562 consensus_queue.cc:260] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a75a2b7f4b194992a529bbd7c30529d9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 34441 } }
I20260809 03:27:09.639175 26562 raft_consensus.cc:388] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:09.639220 26562 raft_consensus.cc:482] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:09.639274 26562 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:09.640329 26562 raft_consensus.cc:504] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a75a2b7f4b194992a529bbd7c30529d9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 34441 } }
I20260809 03:27:09.640455 26562 leader_election.cc:302] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a75a2b7f4b194992a529bbd7c30529d9; no voters:
I20260809 03:27:09.640640 26562 leader_election.cc:288] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:09.640666 26567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:09.640779 26567 raft_consensus.cc:686] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9 [term 1 LEADER]: Becoming Leader. State: Replica: a75a2b7f4b194992a529bbd7c30529d9, State: Running, Role: LEADER
I20260809 03:27:09.640913 26562 sys_catalog.cc:564] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:09.640920 26567 consensus_queue.cc:237] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a75a2b7f4b194992a529bbd7c30529d9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 34441 } }
I20260809 03:27:09.641409 26569 sys_catalog.cc:455] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a75a2b7f4b194992a529bbd7c30529d9. Latest consensus state: current_term: 1 leader_uuid: "a75a2b7f4b194992a529bbd7c30529d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a75a2b7f4b194992a529bbd7c30529d9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 34441 } } }
I20260809 03:27:09.641498 26569 sys_catalog.cc:458] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:09.641451 26568 sys_catalog.cc:455] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a75a2b7f4b194992a529bbd7c30529d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a75a2b7f4b194992a529bbd7c30529d9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 34441 } } }
I20260809 03:27:09.641541 26568 sys_catalog.cc:458] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:09.642591 26574 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:09.643121 26574 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:09.644575 26574 catalog_manager.cc:1347] Generated new cluster ID: add10ea682eb4a78bbdaa1a1a4d36132
I20260809 03:27:09.644622 26574 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 03:27:09 dist-test-slave-2w3w krb5kdc[26473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:09.649082 26566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:09.638200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56994 (local address 127.8.5.254:34441)
0809 03:27:09.638375 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:09.638390 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:09.638420 (+ 30us) server_negotiation.cc:407] Connection header received
0809 03:27:09.638645 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:09.638650 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:09.638692 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:09.638798 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:09.639661 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:09.640646 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:09.641703 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:09.642320 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:09.643019 (+ 699us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:09.645452 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:09.645456 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:09.645456 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:09.645467 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:09.647421 (+ 1954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:09.647824 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:09.647827 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:09.647827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:09.647955 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:09.648178 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:09.648178 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:09.648179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:09.648477 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:09.648614 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:09.648754 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 03:27:09.648888 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":96,"threads_started":1}
I20260809 03:27:09.656196 26574 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:09.656935 26574 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:09.661033 26574 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9: Generated new TSK 0
I20260809 03:27:09.661206 26574 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
I20260809 03:27:09.697954 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:34441
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:38553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:09.786432 26589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:09.786659 26589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:09.786700 26589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:09.787941 26589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:09.788009 26589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:09.788054 26589 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:27:09.789562 26589 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:38553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:34441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:09.789831 26589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:09.790272 26589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:09.795804 26595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:09.795841 26597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:09.795823 26594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:09.796175 26589 server_base.cc:1034] running on GCE node
I20260809 03:27:09.796401 26589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:09.796644 26589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:09.797807 26589 hybrid_clock.cc:648] HybridClock initialized: now 1786246029797798 us; error 35 us; skew 500 ppm
Aug 09 03:27:09 dist-test-slave-2w3w krb5kdc[26473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246029, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:09.800376 26589 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:27:09.800863 26589 webserver.cc:460] Webserver started at http://127.8.5.193:36295/ using document root <none> and password file <none>
I20260809 03:27:09.801110 26589 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:09.801177 26589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:09.801332 26589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:09.802398 26589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "90caa9f864364e088153de08353797f0"
format_stamp: "Formatted at 2026-08-09 03:27:09 on dist-test-slave-2w3w"
server_key: "cb5443f1bc3a619e7ffa9180c9acf087"
server_key_iv: "2e8b5190dcd69a148d68fa2a0c2e524f"
server_key_version: "encryptionkey@0"
I20260809 03:27:09.802770 26589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "90caa9f864364e088153de08353797f0"
format_stamp: "Formatted at 2026-08-09 03:27:09 on dist-test-slave-2w3w"
server_key: "cb5443f1bc3a619e7ffa9180c9acf087"
server_key_iv: "2e8b5190dcd69a148d68fa2a0c2e524f"
server_key_version: "encryptionkey@0"
I20260809 03:27:09.804160 26589 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:27:09.804919 26606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:09.805101 26589 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:27:09.805200 26589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "90caa9f864364e088153de08353797f0"
format_stamp: "Formatted at 2026-08-09 03:27:09 on dist-test-slave-2w3w"
server_key: "cb5443f1bc3a619e7ffa9180c9acf087"
server_key_iv: "2e8b5190dcd69a148d68fa2a0c2e524f"
server_key_version: "encryptionkey@0"
I20260809 03:27:09.805289 26589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:09.814517 26589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:09.816679 26589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:09.816874 26589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:09.817106 26589 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:27:09.817430 26589 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:27:09.817489 26589 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:09.817533 26589 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:27:09.817565 26589 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:09.823932 26589 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:39677
I20260809 03:27:09.823968 26732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:39677 every 8 connection(s)
I20260809 03:27:09.824321 26589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:27:09.824517 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 26589
I20260809 03:27:09.824630 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:27:09.824853 8215 external_mini_cluster.cc:1428] Setting key e17e69db96104bb455d0bbaae386daad
Aug 09 03:27:09 dist-test-slave-2w3w krb5kdc[26473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246029, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:09.834837 26735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:09.825098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:34441 (local address 127.8.5.193:53455)
0809 03:27:09.825296 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:09.825339 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:09.825928 (+ 589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:09.826197 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:09.826202 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:09.826815 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:09.827114 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:09.827126 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:09.827916 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:09.827917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:09.828810 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:09.828813 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:09.829375 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:09.829376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:09.829489 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:09.829995 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:09.830004 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:09.831476 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:09.833486 (+ 2010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:09.833493 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:09.833494 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:09.833703 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:09.833947 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:09.833947 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:09.833947 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:09.834040 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:09.834353 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:09.834357 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:09.834468 (+ 111us) client_negotiation.cc:769] Sending connection context
0809 03:27:09.834548 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 03:27:09.834664 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":110,"threads_started":1}
I20260809 03:27:09.834887 26566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:09.825093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:53455 (local address 127.8.5.254:34441)
0809 03:27:09.825166 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:09.825168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:09.825435 (+ 267us) server_negotiation.cc:407] Connection header received
0809 03:27:09.826056 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:09.826058 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:09.826074 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:09.826125 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:09.827236 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:09.827801 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:09.828924 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:09.829285 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:09.829365 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:09.831575 (+ 2210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:09.831577 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:09.831578 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:09.831587 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:09.833404 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:09.833795 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:09.833796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:09.833797 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:09.833868 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:09.834108 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:09.834109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:09.834110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:09.834272 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:09.834354 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:09.834605 (+ 251us) server_negotiation.cc:299] Negotiation successful
0809 03:27:09.834714 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 03:27:09.835552 26733 heartbeater.cc:347] Connected to a master server at 127.8.5.254:34441
I20260809 03:27:09.835659 26733 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.8.5.194@KRBTEST.COM; defaulting to no policy
I20260809 03:27:09.835888 26733 heartbeater.cc:511] Master 127.8.5.254:34441 requested a full tablet report, sending...
I20260809 03:27:09.836390 26523 ts_manager.cc:194] Registered new tserver with Master: 90caa9f864364e088153de08353797f0 (127.8.5.193:39677)
I20260809 03:27:09.837059 26523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:53455
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
I20260809 03:27:09.854048 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:34441
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:38553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:09.936407 26738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:09.936599 26738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:09.936619 26738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:09.937681 26738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:09.937732 26738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:09.937757 26738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:27:09.939111 26738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:38553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:34441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:09.939282 26738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:09.939448 26738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:09.944525 26749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:09.944542 26746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:09.944543 26747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:09.944728 26738 server_base.cc:1034] running on GCE node
I20260809 03:27:09.944998 26738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:09.945241 26738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:09.946420 26738 hybrid_clock.cc:648] HybridClock initialized: now 1786246029946415 us; error 40 us; skew 500 ppm
Aug 09 03:27:09 dist-test-slave-2w3w krb5kdc[26473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246029, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:09.949064 26738 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:27:09.949445 26738 webserver.cc:460] Webserver started at http://127.8.5.194:46855/ using document root <none> and password file <none>
I20260809 03:27:09.949615 26738 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:09.949652 26738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:09.949738 26738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:09.950686 26738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "61cc6aefb784452e9c5fa7066a487abb"
format_stamp: "Formatted at 2026-08-09 03:27:09 on dist-test-slave-2w3w"
server_key: "1816f76c493220cd4266241c0c22bb5f"
server_key_iv: "f0db4c8a071e54b22ddb92763f66c71d"
server_key_version: "encryptionkey@0"
I20260809 03:27:09.951066 26738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "61cc6aefb784452e9c5fa7066a487abb"
format_stamp: "Formatted at 2026-08-09 03:27:09 on dist-test-slave-2w3w"
server_key: "1816f76c493220cd4266241c0c22bb5f"
server_key_iv: "f0db4c8a071e54b22ddb92763f66c71d"
server_key_version: "encryptionkey@0"
I20260809 03:27:09.952310 26738 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:09.952929 26757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:09.953115 26738 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:27:09.953200 26738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "61cc6aefb784452e9c5fa7066a487abb"
format_stamp: "Formatted at 2026-08-09 03:27:09 on dist-test-slave-2w3w"
server_key: "1816f76c493220cd4266241c0c22bb5f"
server_key_iv: "f0db4c8a071e54b22ddb92763f66c71d"
server_key_version: "encryptionkey@0"
I20260809 03:27:09.953275 26738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:09.972204 26738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:09.974241 26738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:09.974411 26738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:09.974676 26738 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:27:09.975087 26738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:27:09.975126 26738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:09.975147 26738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:27:09.975188 26738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:09.981009 26738 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:42389
I20260809 03:27:09.981109 26881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:42389 every 8 connection(s)
I20260809 03:27:09.981410 26738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
Aug 09 03:27:09 dist-test-slave-2w3w krb5kdc[26473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246029, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:09.989303 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 26738
I20260809 03:27:09.989441 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:27:09.989683 8215 external_mini_cluster.cc:1428] Setting key 323cdd4663180ae7684c0e3626089175
I20260809 03:27:09.990437 26566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:09.982122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:43541 (local address 127.8.5.254:34441)
0809 03:27:09.982175 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:09.982177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:09.982428 (+ 251us) server_negotiation.cc:407] Connection header received
0809 03:27:09.982895 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:09.982896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:09.982906 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:09.983014 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:09.983880 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:09.984391 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:09.985332 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:09.985511 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:09.985561 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:09.987602 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:09.987603 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:09.987603 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:09.987610 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:09.988968 (+ 1358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:09.989317 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:09.989318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:09.989318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:09.989380 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:09.989707 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:09.989708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:09.989708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:09.989861 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:09.989924 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:09.990249 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 03:27:09.990347 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:27:09.990669 26885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:09.982091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:34441 (local address 127.8.5.194:43541)
0809 03:27:09.982290 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:09.982340 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:09.982809 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:09.983044 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:09.983047 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:09.983619 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:09.983799 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:09.983804 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:09.984470 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:09.984471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:09.985251 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:09.985253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:09.985581 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:09.985582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:09.985679 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:09.986121 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:09.986128 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:09.987519 (+ 1391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:09.989035 (+ 1516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:09.989041 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:09.989043 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:09.989243 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:09.989478 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:09.989479 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:09.989480 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:09.989634 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:09.989936 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:09.989944 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:09.990119 (+ 175us) client_negotiation.cc:769] Sending connection context
0809 03:27:09.990227 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 03:27:09.990406 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":122,"threads_started":1}
I20260809 03:27:09.991233 26882 heartbeater.cc:347] Connected to a master server at 127.8.5.254:34441
I20260809 03:27:09.991341 26882 heartbeater.cc:464] Registering TS with master...
I20260809 03:27:09.991523 26882 heartbeater.cc:511] Master 127.8.5.254:34441 requested a full tablet report, sending...
I20260809 03:27:09.991912 26523 ts_manager.cc:194] Registered new tserver with Master: 61cc6aefb784452e9c5fa7066a487abb (127.8.5.194:42389)
I20260809 03:27:09.992333 26523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:43541
WARNING: no policy specified for kudu/127.8.5.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
I20260809 03:27:10.017760 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:34441
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:38553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:10.101172 26889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:10.101552 26889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:10.101629 26889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:10.103389 26889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:10.103449 26889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:10.103493 26889 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:27:10.105501 26889 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:38553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:34441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:10.105790 26889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:10.106060 26889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:10.111191 26894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:10.111166 26897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:10.111166 26895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:10.111256 26889 server_base.cc:1034] running on GCE node
I20260809 03:27:10.111631 26889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:10.111876 26889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:10.113019 26889 hybrid_clock.cc:648] HybridClock initialized: now 1786246030113009 us; error 27 us; skew 500 ppm
Aug 09 03:27:10 dist-test-slave-2w3w krb5kdc[26473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246030, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:10.115700 26889 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:27:10.116080 26889 webserver.cc:460] Webserver started at http://127.8.5.195:44463/ using document root <none> and password file <none>
I20260809 03:27:10.116324 26889 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:10.116385 26889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:10.116485 26889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:10.117486 26889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "4692997578b44319ba0b9ac8898d9ee5"
format_stamp: "Formatted at 2026-08-09 03:27:10 on dist-test-slave-2w3w"
server_key: "0c72b3fef2dadc56da9c2b4208626fe1"
server_key_iv: "4500516660293d58320a73891722a026"
server_key_version: "encryptionkey@0"
I20260809 03:27:10.117791 26889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "4692997578b44319ba0b9ac8898d9ee5"
format_stamp: "Formatted at 2026-08-09 03:27:10 on dist-test-slave-2w3w"
server_key: "0c72b3fef2dadc56da9c2b4208626fe1"
server_key_iv: "4500516660293d58320a73891722a026"
server_key_version: "encryptionkey@0"
I20260809 03:27:10.119096 26889 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 03:27:10.119786 26905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:10.119952 26889 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:10.120059 26889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "4692997578b44319ba0b9ac8898d9ee5"
format_stamp: "Formatted at 2026-08-09 03:27:10 on dist-test-slave-2w3w"
server_key: "0c72b3fef2dadc56da9c2b4208626fe1"
server_key_iv: "4500516660293d58320a73891722a026"
server_key_version: "encryptionkey@0"
I20260809 03:27:10.120137 26889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:10.129635 26889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:10.131973 26889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:10.132140 26889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:10.132365 26889 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:27:10.132668 26889 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:27:10.132721 26889 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:10.132762 26889 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:27:10.132792 26889 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:10.139166 26889 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:45585
I20260809 03:27:10.139211 27031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:45585 every 8 connection(s)
I20260809 03:27:10.139593 26889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:27:10.143862 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 26889
I20260809 03:27:10.144002 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:27:10.144213 8215 external_mini_cluster.cc:1428] Setting key 265899d4d8f0f67cf0b60168224845cb
Aug 09 03:27:10 dist-test-slave-2w3w krb5kdc[26473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246030, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:10.149135 26566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.140420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:42513 (local address 127.8.5.254:34441)
0809 03:27:10.140465 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:10.140468 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:10.140745 (+ 277us) server_negotiation.cc:407] Connection header received
0809 03:27:10.141278 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:10.141279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:10.141294 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:10.141361 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:10.142452 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.143096 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.144222 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.144503 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.144577 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.146641 (+ 2064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:10.146642 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:10.146642 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:10.146650 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:10.147970 (+ 1320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:10.148327 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:10.148328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:10.148328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:10.148380 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:10.148581 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:10.148582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:10.148582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:10.148687 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:10.148736 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:10.148997 (+ 261us) server_negotiation.cc:299] Negotiation successful
0809 03:27:10.149072 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 03:27:10.149456 27036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.140408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:34441 (local address 127.8.5.195:42513)
0809 03:27:10.140601 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:10.140657 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:10.141171 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:10.141447 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:10.141451 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:10.142114 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:10.142350 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:10.142355 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.143191 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.143192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:10.144138 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:10.144140 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.144598 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.144599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:10.144739 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.145178 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:10.145186 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:10.146536 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:10.148039 (+ 1503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:10.148045 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:10.148047 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:10.148260 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:10.148434 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:10.148435 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:10.148435 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:10.148528 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:10.148749 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:10.148754 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:10.148880 (+ 126us) client_negotiation.cc:769] Sending connection context
0809 03:27:10.148967 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 03:27:10.149158 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":71,"threads_started":1}
I20260809 03:27:10.150010 27032 heartbeater.cc:347] Connected to a master server at 127.8.5.254:34441
I20260809 03:27:10.150108 27032 heartbeater.cc:464] Registering TS with master...
I20260809 03:27:10.150249 27032 heartbeater.cc:511] Master 127.8.5.254:34441 requested a full tablet report, sending...
I20260809 03:27:10.150633 26523 ts_manager.cc:194] Registered new tserver with Master: 4692997578b44319ba0b9ac8898d9ee5 (127.8.5.195:45585)
I20260809 03:27:10.151034 26523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:42513
I20260809 03:27:10.156278 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:27:10.164016 26566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.157679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57006 (local address 127.8.5.254:34441)
0809 03:27:10.157751 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:10.157753 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:10.157874 (+ 121us) server_negotiation.cc:407] Connection header received
0809 03:27:10.157979 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:10.157980 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:10.157990 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:10.158058 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:10.158599 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.159151 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.159897 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.160103 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.160178 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.161490 (+ 1312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:10.161492 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:10.161492 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:10.161501 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:10.162786 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:10.163198 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:10.163199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:10.163200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:10.163263 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:10.163475 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:10.163476 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:10.163476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:10.163625 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:10.163730 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:10.163834 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 03:27:10.163914 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 03:27:10.165474 26523 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57006:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:27:10.167043 26523 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:27:10.173914 27047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.169511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59612 (local address 127.8.5.195:45585)
0809 03:27:10.170081 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:10.170085 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:10.170095 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:27:10.170135 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:10.170137 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:10.170151 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:10.170228 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:10.170371 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.171351 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.172826 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.173456 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.173532 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.173588 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:10.173770 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 03:27:10.173813 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":101,"threads_started":1}
I20260809 03:27:10.173920 27049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.169411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:45585 (local address 127.0.0.1:59612)
0809 03:27:10.169747 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:10.169756 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:10.169817 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:10.170250 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:10.170252 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:10.170255 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:10.170306 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:10.170308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.171462 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.171463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:10.172731 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:10.172734 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.173552 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.173553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:10.173641 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.173655 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 03:27:10.173753 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 03:27:10.173814 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":98,"thread_start_us":85,"threads_started":1}
I20260809 03:27:10.174296 27046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.169411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:42389 (local address 127.0.0.1:46688)
0809 03:27:10.169613 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:10.169661 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:10.169730 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:10.170123 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:10.170126 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:10.170129 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:10.170203 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:10.170205 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.171593 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.171594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:10.173039 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:10.173042 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.174043 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.174044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:10.174117 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.174121 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:27:10.174166 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 03:27:10.174210 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":91,"thread_start_us":55,"threads_started":1}
I20260809 03:27:10.174400 27045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.169616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:39677 (local address 127.0.0.1:54344)
0809 03:27:10.169863 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:10.169882 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:10.169926 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:10.170549 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:10.170550 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:10.170553 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:10.170594 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:10.170596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.171785 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.171786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:10.173040 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:10.173042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.173996 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.173997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:10.174073 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.174078 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 03:27:10.174133 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 03:27:10.174182 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":6,"thread_start_us":89,"threads_started":1}
I20260809 03:27:10.174569 27050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.169883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54344 (local address 127.8.5.193:39677)
0809 03:27:10.170062 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:10.170067 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:10.170078 (+ 11us) server_negotiation.cc:407] Connection header received
0809 03:27:10.170119 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:10.170121 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:10.170458 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:10.170539 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:10.170658 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.171685 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.173157 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.173830 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.173898 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.173956 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:10.174263 (+ 307us) server_negotiation.cc:299] Negotiation successful
0809 03:27:10.174338 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":108,"threads_started":1}
I20260809 03:27:10.174625 27048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.169523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46688 (local address 127.8.5.194:42389)
0809 03:27:10.169924 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:10.169930 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:10.169942 (+ 12us) server_negotiation.cc:407] Connection header received
0809 03:27:10.169987 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:10.169990 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:10.170010 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:10.170098 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:10.170295 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.171489 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.173149 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.173869 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.173941 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.174000 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:10.174485 (+ 485us) server_negotiation.cc:299] Negotiation successful
0809 03:27:10.174538 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":83,"threads_started":1}
I20260809 03:27:10.175038 26960 tablet_service.cc:1467] Processing CreateTablet for tablet 9138231d9ef44e3196367301f472f6cb (DEFAULT_TABLE table=test-table [id=139b2fbf24f044d4961f38600bbda9bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:27:10.175246 26662 tablet_service.cc:1467] Processing CreateTablet for tablet 9138231d9ef44e3196367301f472f6cb (DEFAULT_TABLE table=test-table [id=139b2fbf24f044d4961f38600bbda9bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:27:10.175467 26960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9138231d9ef44e3196367301f472f6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:10.175336 26810 tablet_service.cc:1467] Processing CreateTablet for tablet 9138231d9ef44e3196367301f472f6cb (DEFAULT_TABLE table=test-table [id=139b2fbf24f044d4961f38600bbda9bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:27:10.175580 26662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9138231d9ef44e3196367301f472f6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:10.175721 26810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9138231d9ef44e3196367301f472f6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:10.178512 27051 tablet_bootstrap.cc:492] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb: Bootstrap starting.
I20260809 03:27:10.179118 27053 tablet_bootstrap.cc:492] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0: Bootstrap starting.
I20260809 03:27:10.179302 27051 tablet_bootstrap.cc:654] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:10.179836 27053 tablet_bootstrap.cc:654] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:10.179955 27051 log.cc:824] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:10.180413 27053 log.cc:824] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:10.180760 27052 tablet_bootstrap.cc:492] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5: Bootstrap starting.
I20260809 03:27:10.181142 27051 tablet_bootstrap.cc:492] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb: No bootstrap required, opened a new log
I20260809 03:27:10.181190 27053 tablet_bootstrap.cc:492] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0: No bootstrap required, opened a new log
I20260809 03:27:10.181241 27051 ts_tablet_manager.cc:1397] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 03:27:10.181257 27053 ts_tablet_manager.cc:1397] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:27:10.181444 27052 tablet_bootstrap.cc:654] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:10.182013 27052 log.cc:824] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:10.182839 27052 tablet_bootstrap.cc:492] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5: No bootstrap required, opened a new log
I20260809 03:27:10.182911 27052 ts_tablet_manager.cc:1397] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:27:10.183056 27053 raft_consensus.cc:348] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4692997578b44319ba0b9ac8898d9ee5" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45585 } } peers { permanent_uuid: "61cc6aefb784452e9c5fa7066a487abb" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 42389 } } peers { permanent_uuid: "90caa9f864364e088153de08353797f0" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39677 } }
I20260809 03:27:10.183236 27053 raft_consensus.cc:374] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:10.183283 27053 raft_consensus.cc:729] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90caa9f864364e088153de08353797f0, State: Initialized, Role: FOLLOWER
I20260809 03:27:10.183420 27053 consensus_queue.cc:260] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4692997578b44319ba0b9ac8898d9ee5" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45585 } } peers { permanent_uuid: "61cc6aefb784452e9c5fa7066a487abb" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 42389 } } peers { permanent_uuid: "90caa9f864364e088153de08353797f0" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39677 } }
I20260809 03:27:10.183389 27051 raft_consensus.cc:348] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4692997578b44319ba0b9ac8898d9ee5" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45585 } } peers { permanent_uuid: "61cc6aefb784452e9c5fa7066a487abb" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 42389 } } peers { permanent_uuid: "90caa9f864364e088153de08353797f0" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39677 } }
I20260809 03:27:10.183564 27051 raft_consensus.cc:374] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:10.183598 27051 raft_consensus.cc:729] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61cc6aefb784452e9c5fa7066a487abb, State: Initialized, Role: FOLLOWER
I20260809 03:27:10.183714 27053 ts_tablet_manager.cc:1428] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 03:27:10.183715 27051 consensus_queue.cc:260] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4692997578b44319ba0b9ac8898d9ee5" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45585 } } peers { permanent_uuid: "61cc6aefb784452e9c5fa7066a487abb" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 42389 } } peers { permanent_uuid: "90caa9f864364e088153de08353797f0" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39677 } }
I20260809 03:27:10.183874 26733 heartbeater.cc:503] Master 127.8.5.254:34441 was elected leader, sending a full tablet report...
I20260809 03:27:10.184289 27051 ts_tablet_manager.cc:1428] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 03:27:10.184444 26882 heartbeater.cc:503] Master 127.8.5.254:34441 was elected leader, sending a full tablet report...
I20260809 03:27:10.185047 27052 raft_consensus.cc:348] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4692997578b44319ba0b9ac8898d9ee5" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45585 } } peers { permanent_uuid: "61cc6aefb784452e9c5fa7066a487abb" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 42389 } } peers { permanent_uuid: "90caa9f864364e088153de08353797f0" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39677 } }
I20260809 03:27:10.185226 27052 raft_consensus.cc:374] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:10.185271 27052 raft_consensus.cc:729] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4692997578b44319ba0b9ac8898d9ee5, State: Initialized, Role: FOLLOWER
I20260809 03:27:10.185407 27052 consensus_queue.cc:260] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4692997578b44319ba0b9ac8898d9ee5" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45585 } } peers { permanent_uuid: "61cc6aefb784452e9c5fa7066a487abb" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 42389 } } peers { permanent_uuid: "90caa9f864364e088153de08353797f0" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39677 } }
I20260809 03:27:10.185705 27052 ts_tablet_manager.cc:1428] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 03:27:10.185727 27032 heartbeater.cc:503] Master 127.8.5.254:34441 was elected leader, sending a full tablet report...
W20260809 03:27:10.232049 26883 tablet.cc:2369] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 03:27:10.325243 26734 tablet.cc:2369] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 03:27:10.390195 27034 tablet.cc:2369] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:27:10.467864 27060 raft_consensus.cc:482] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:27:10.467998 27060 raft_consensus.cc:504] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4692997578b44319ba0b9ac8898d9ee5" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45585 } } peers { permanent_uuid: "61cc6aefb784452e9c5fa7066a487abb" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 42389 } } peers { permanent_uuid: "90caa9f864364e088153de08353797f0" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39677 } }
I20260809 03:27:10.468407 27060 leader_election.cc:288] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4692997578b44319ba0b9ac8898d9ee5 (127.8.5.195:45585), 90caa9f864364e088153de08353797f0 (127.8.5.193:39677)
I20260809 03:27:10.468442 27059 raft_consensus.cc:482] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:27:10.468545 27059 raft_consensus.cc:504] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4692997578b44319ba0b9ac8898d9ee5" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45585 } } peers { permanent_uuid: "61cc6aefb784452e9c5fa7066a487abb" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 42389 } } peers { permanent_uuid: "90caa9f864364e088153de08353797f0" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39677 } }
I20260809 03:27:10.468918 27059 leader_election.cc:288] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4692997578b44319ba0b9ac8898d9ee5 (127.8.5.195:45585), 61cc6aefb784452e9c5fa7066a487abb (127.8.5.194:42389)
I20260809 03:27:10.472273 26885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.468618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:45585 (local address 127.8.5.194:46609)
0809 03:27:10.468682 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:10.468694 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:10.468741 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:10.469030 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:10.469031 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:10.469033 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:10.469120 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:10.469123 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.470080 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.470081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:10.471276 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:10.471278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.472025 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.472026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:10.472107 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.472111 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:27:10.472157 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 03:27:10.472197 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 03:27:10.472391 27050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.468784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:54379 (local address 127.8.5.193:39677)
0809 03:27:10.468874 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:10.468876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:10.469016 (+ 140us) server_negotiation.cc:407] Connection header received
0809 03:27:10.469130 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:10.469132 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:10.469144 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:10.469174 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:10.469429 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.470150 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.471530 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.472034 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.472073 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.472082 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:10.472278 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 03:27:10.472310 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 03:27:10.472563 27047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.468718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:46609 (local address 127.8.5.195:45585)
0809 03:27:10.468794 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:10.468797 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:10.468808 (+ 11us) server_negotiation.cc:407] Connection header received
0809 03:27:10.468839 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:10.468867 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:10.468880 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:10.468951 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:10.469210 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.469993 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.471381 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.471923 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.471982 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.471994 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:10.472457 (+ 463us) server_negotiation.cc:299] Negotiation successful
0809 03:27:10.472497 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 03:27:10.472666 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.468618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:39677 (local address 127.8.5.194:54379)
0809 03:27:10.468958 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:10.468968 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:10.469043 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:10.469243 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:10.469244 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:10.469246 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:10.469327 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:10.469329 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.470239 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.470239 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:10.471434 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:10.471437 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.472136 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.472136 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:10.472206 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.472209 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:27:10.472508 (+ 299us) client_negotiation.cc:240] Negotiation successful
0809 03:27:10.472557 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"mutex_wait_us":172,"thread_start_us":90,"threads_started":1}
I20260809 03:27:10.472752 27063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.469004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:45585 (local address 127.8.5.193:55357)
0809 03:27:10.469363 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:10.469372 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:10.469441 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:10.469637 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:10.469637 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:10.469639 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:10.469701 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:10.469702 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.470547 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.470548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:10.471738 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:10.471740 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.472497 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.472498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:10.472568 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.472573 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 03:27:10.472622 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 03:27:10.472671 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":54,"threads_started":1}
I20260809 03:27:10.472821 26980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9138231d9ef44e3196367301f472f6cb" candidate_uuid: "61cc6aefb784452e9c5fa7066a487abb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4692997578b44319ba0b9ac8898d9ee5" is_pre_election: true
I20260809 03:27:10.472941 27065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.469175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:55357 (local address 127.8.5.195:45585)
0809 03:27:10.469427 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:10.469429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:10.469438 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:27:10.469532 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:10.469533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:10.469541 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:10.469601 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:10.469762 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.470454 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.471825 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.472390 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.472453 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.472464 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:10.472828 (+ 364us) server_negotiation.cc:299] Negotiation successful
0809 03:27:10.472881 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":80,"threads_started":1}
I20260809 03:27:10.472968 26980 raft_consensus.cc:2454] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61cc6aefb784452e9c5fa7066a487abb in term 0.
I20260809 03:27:10.472987 26682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9138231d9ef44e3196367301f472f6cb" candidate_uuid: "61cc6aefb784452e9c5fa7066a487abb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90caa9f864364e088153de08353797f0" is_pre_election: true
I20260809 03:27:10.473091 26682 raft_consensus.cc:2454] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61cc6aefb784452e9c5fa7066a487abb in term 0.
I20260809 03:27:10.473227 27048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.469287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:57763 (local address 127.8.5.194:42389)
0809 03:27:10.469323 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:10.469325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:10.469559 (+ 234us) server_negotiation.cc:407] Connection header received
0809 03:27:10.469645 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:10.469645 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:10.469654 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:10.469681 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:10.469890 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.470552 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.471919 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.472433 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.472476 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.472486 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:10.473131 (+ 645us) server_negotiation.cc:299] Negotiation successful
0809 03:27:10.473176 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:27:10.473234 27064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.469137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:42389 (local address 127.8.5.193:57763)
0809 03:27:10.469501 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:10.469511 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:10.469581 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:10.469730 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:10.469731 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:10.469732 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:10.469797 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:10.469799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.470646 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.470647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:10.471832 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:10.471834 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.472979 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.472980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:10.473042 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.473045 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:27:10.473104 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 03:27:10.473141 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":71,"threads_started":1}
I20260809 03:27:10.473254 26761 leader_election.cc:302] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4692997578b44319ba0b9ac8898d9ee5, 61cc6aefb784452e9c5fa7066a487abb; no voters:
I20260809 03:27:10.473368 27060 raft_consensus.cc:2781] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:27:10.473412 27060 raft_consensus.cc:482] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:27:10.473439 27060 raft_consensus.cc:3037] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:10.473511 26980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9138231d9ef44e3196367301f472f6cb" candidate_uuid: "90caa9f864364e088153de08353797f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4692997578b44319ba0b9ac8898d9ee5" is_pre_election: true
I20260809 03:27:10.473587 26980 raft_consensus.cc:2454] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90caa9f864364e088153de08353797f0 in term 0.
I20260809 03:27:10.473618 26831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9138231d9ef44e3196367301f472f6cb" candidate_uuid: "90caa9f864364e088153de08353797f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61cc6aefb784452e9c5fa7066a487abb" is_pre_election: true
I20260809 03:27:10.473764 26611 leader_election.cc:302] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4692997578b44319ba0b9ac8898d9ee5, 90caa9f864364e088153de08353797f0; no voters:
I20260809 03:27:10.473905 27059 raft_consensus.cc:2781] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:27:10.473942 27059 raft_consensus.cc:482] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:27:10.473963 27059 raft_consensus.cc:3037] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:10.474433 27060 raft_consensus.cc:504] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4692997578b44319ba0b9ac8898d9ee5" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45585 } } peers { permanent_uuid: "61cc6aefb784452e9c5fa7066a487abb" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 42389 } } peers { permanent_uuid: "90caa9f864364e088153de08353797f0" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39677 } }
I20260809 03:27:10.474586 27060 leader_election.cc:288] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [CANDIDATE]: Term 1 election: Requested vote from peers 4692997578b44319ba0b9ac8898d9ee5 (127.8.5.195:45585), 90caa9f864364e088153de08353797f0 (127.8.5.193:39677)
I20260809 03:27:10.474587 26831 raft_consensus.cc:2379] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 90caa9f864364e088153de08353797f0 in current term 1: Already voted for candidate 61cc6aefb784452e9c5fa7066a487abb in this term.
I20260809 03:27:10.474702 26980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9138231d9ef44e3196367301f472f6cb" candidate_uuid: "61cc6aefb784452e9c5fa7066a487abb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4692997578b44319ba0b9ac8898d9ee5"
I20260809 03:27:10.474761 26682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9138231d9ef44e3196367301f472f6cb" candidate_uuid: "61cc6aefb784452e9c5fa7066a487abb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90caa9f864364e088153de08353797f0"
I20260809 03:27:10.474792 26980 raft_consensus.cc:3037] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:10.475411 27059 raft_consensus.cc:504] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4692997578b44319ba0b9ac8898d9ee5" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45585 } } peers { permanent_uuid: "61cc6aefb784452e9c5fa7066a487abb" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 42389 } } peers { permanent_uuid: "90caa9f864364e088153de08353797f0" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39677 } }
I20260809 03:27:10.475548 26682 raft_consensus.cc:2379] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 61cc6aefb784452e9c5fa7066a487abb in current term 1: Already voted for candidate 90caa9f864364e088153de08353797f0 in this term.
I20260809 03:27:10.475555 26980 raft_consensus.cc:2454] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61cc6aefb784452e9c5fa7066a487abb in term 1.
I20260809 03:27:10.475700 26761 leader_election.cc:302] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4692997578b44319ba0b9ac8898d9ee5, 61cc6aefb784452e9c5fa7066a487abb; no voters:
I20260809 03:27:10.475721 26980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9138231d9ef44e3196367301f472f6cb" candidate_uuid: "90caa9f864364e088153de08353797f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4692997578b44319ba0b9ac8898d9ee5"
I20260809 03:27:10.475778 27059 leader_election.cc:288] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0 [CANDIDATE]: Term 1 election: Requested vote from peers 4692997578b44319ba0b9ac8898d9ee5 (127.8.5.195:45585), 61cc6aefb784452e9c5fa7066a487abb (127.8.5.194:42389)
I20260809 03:27:10.475826 26980 raft_consensus.cc:2379] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 90caa9f864364e088153de08353797f0 in current term 1: Already voted for candidate 61cc6aefb784452e9c5fa7066a487abb in this term.
I20260809 03:27:10.475823 26831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9138231d9ef44e3196367301f472f6cb" candidate_uuid: "90caa9f864364e088153de08353797f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61cc6aefb784452e9c5fa7066a487abb"
I20260809 03:27:10.475868 27060 raft_consensus.cc:2781] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:10.476044 27060 raft_consensus.cc:686] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [term 1 LEADER]: Becoming Leader. State: Replica: 61cc6aefb784452e9c5fa7066a487abb, State: Running, Role: LEADER
I20260809 03:27:10.476145 27060 consensus_queue.cc:237] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4692997578b44319ba0b9ac8898d9ee5" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45585 } } peers { permanent_uuid: "61cc6aefb784452e9c5fa7066a487abb" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 42389 } } peers { permanent_uuid: "90caa9f864364e088153de08353797f0" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39677 } }
I20260809 03:27:10.476684 26608 leader_election.cc:302] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90caa9f864364e088153de08353797f0; no voters: 4692997578b44319ba0b9ac8898d9ee5, 61cc6aefb784452e9c5fa7066a487abb
I20260809 03:27:10.476914 27059 raft_consensus.cc:2726] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260809 03:27:10.477042 26523 catalog_manager.cc:5495] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb reported cstate change: term changed from 0 to 1, leader changed from <none> to 61cc6aefb784452e9c5fa7066a487abb (127.8.5.194). New cstate: current_term: 1 leader_uuid: "61cc6aefb784452e9c5fa7066a487abb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4692997578b44319ba0b9ac8898d9ee5" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61cc6aefb784452e9c5fa7066a487abb" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 42389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90caa9f864364e088153de08353797f0" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39677 } health_report { overall_health: UNKNOWN } } }
I20260809 03:27:10.528956 27048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.526473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46696 (local address 127.8.5.194:42389)
0809 03:27:10.526534 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:10.526536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:10.526543 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:27:10.526589 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:10.526590 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:10.526609 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:10.526689 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:27:10.526847 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.527351 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.528134 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.528329 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.528413 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.528589 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:27:10.528696 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:27:10.528784 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:10.528823 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 03:27:10.528844 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 03:27:10.530861 26980 raft_consensus.cc:1261] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5 [term 1 FOLLOWER]: Refusing update from remote peer 61cc6aefb784452e9c5fa7066a487abb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:27:10.531026 26682 raft_consensus.cc:1261] T 9138231d9ef44e3196367301f472f6cb P 90caa9f864364e088153de08353797f0 [term 1 FOLLOWER]: Refusing update from remote peer 61cc6aefb784452e9c5fa7066a487abb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:27:10.531219 27066 consensus_queue.cc:1035] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4692997578b44319ba0b9ac8898d9ee5" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:27:10.531432 27060 consensus_queue.cc:1035] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [LEADER]: Connected to new peer: Peer: permanent_uuid: "90caa9f864364e088153de08353797f0" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:27:10.533987 27070 mvcc.cc:205] Tried to move back new op lower bound from 7316463741051170816 to 7316463740830973952. Current Snapshot: MvccSnapshot[applied={T|T < 7316463741051170816}]
I20260809 03:27:10.534515 27069 mvcc.cc:205] Tried to move back new op lower bound from 7316463741051170816 to 7316463740830973952. Current Snapshot: MvccSnapshot[applied={T|T < 7316463741051170816}]
I20260809 03:27:10.536675 26523 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57006:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:27:10.536785 26523 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57006:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:27:10.537519 26523 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a75a2b7f4b194992a529bbd7c30529d9: Sending DeleteTablet for 3 replicas of tablet 9138231d9ef44e3196367301f472f6cb
I20260809 03:27:10.537853 26960 tablet_service.cc:1514] Processing DeleteTablet for tablet 9138231d9ef44e3196367301f472f6cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:27:10 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:59612
I20260809 03:27:10.537890 26662 tablet_service.cc:1514] Processing DeleteTablet for tablet 9138231d9ef44e3196367301f472f6cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:27:10 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:54344
I20260809 03:27:10.538033 26810 tablet_service.cc:1514] Processing DeleteTablet for tablet 9138231d9ef44e3196367301f472f6cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:27:10 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:46688
I20260809 03:27:10.538100 27079 tablet_replica.cc:330] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5: stopping tablet replica
I20260809 03:27:10.538192 27079 raft_consensus.cc:2229] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:27:10.538244 27081 tablet_replica.cc:330] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb: stopping tablet replica
I20260809 03:27:10.538283 27079 raft_consensus.cc:2258] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:27:10.538333 27081 raft_consensus.cc:2229] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:27:10.538476 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 26589
I20260809 03:27:10.538545 27081 raft_consensus.cc:2258] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:27:10.538817 27079 ts_tablet_manager.cc:1905] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:27:10.541008 27079 ts_tablet_manager.cc:1918] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:27:10.541086 27079 log.cc:1196] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/9138231d9ef44e3196367301f472f6cb
I20260809 03:27:10.541373 27079 ts_tablet_manager.cc:1939] T 9138231d9ef44e3196367301f472f6cb P 4692997578b44319ba0b9ac8898d9ee5: Deleting consensus metadata
I20260809 03:27:10.541712 27081 ts_tablet_manager.cc:1905] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:27:10.541749 26510 catalog_manager.cc:4841] TS 4692997578b44319ba0b9ac8898d9ee5 (127.8.5.195:45585): tablet 9138231d9ef44e3196367301f472f6cb (table test-table [id=139b2fbf24f044d4961f38600bbda9bd]) successfully deleted
I20260809 03:27:10.543646 27081 ts_tablet_manager.cc:1918] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:27:10.543695 27081 log.cc:1196] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/9138231d9ef44e3196367301f472f6cb
I20260809 03:27:10.543968 27081 ts_tablet_manager.cc:1939] T 9138231d9ef44e3196367301f472f6cb P 61cc6aefb784452e9c5fa7066a487abb: Deleting consensus metadata
I20260809 03:27:10.544620 26506 catalog_manager.cc:4841] TS 61cc6aefb784452e9c5fa7066a487abb (127.8.5.194:42389): tablet 9138231d9ef44e3196367301f472f6cb (table test-table [id=139b2fbf24f044d4961f38600bbda9bd]) successfully deleted
W20260809 03:27:10.549201 26506 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.5.193:39677 (error 108)
I20260809 03:27:10.549451 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 26738
I20260809 03:27:10.551653 27045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.551478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:39677 (local address 127.0.0.1:54356)
0809 03:27:10.551550 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:10.551613 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.193:39677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 03:27:10.551805 26506 catalog_manager.cc:4584] TS 90caa9f864364e088153de08353797f0 (127.8.5.193:39677): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9138231d9ef44e3196367301f472f6cb: Network error: Client connection negotiation failed: client connection to 127.8.5.193:39677: connect: Connection refused (error 111)
I20260809 03:27:10.556002 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 26889
I20260809 03:27:10.562000 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 26486
2026-08-09T03:27:10Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2289 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T03:27:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:10Z Disabled control of system clock
I20260809 03:27:10.595916 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:42919
--webserver_interface=127.8.5.254
--webserver_port=0
--builtin_ntp_servers=127.8.5.212:37741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:42919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 03:27:10.683708 27087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:10.683954 27087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:10.683979 27087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:10.685189 27087 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:10.685233 27087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:10.685246 27087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:10.685259 27087 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:10.685271 27087 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:10.686664 27087 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:37741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:42919
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:42919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:10.686865 27087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:10.687126 27087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:10.692130 27093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:10.692101 27087 server_base.cc:1034] running on GCE node
W20260809 03:27:10.692070 27094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:10.692070 27096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:10.692610 27087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:10.692920 27087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:10.694067 27087 hybrid_clock.cc:648] HybridClock initialized: now 1786246030694043 us; error 35 us; skew 500 ppm
I20260809 03:27:10.695335 27087 webserver.cc:460] Webserver started at http://127.8.5.254:42221/ using document root <none> and password file <none>
I20260809 03:27:10.695587 27087 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:10.695634 27087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:10.695786 27087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:10.696870 27087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "1428dadbe5224e12a18abe5b01100013"
format_stamp: "Formatted at 2026-08-09 03:27:10 on dist-test-slave-2w3w"
server_key: "396cd7c81f4980010abd8db168aaf46c"
server_key_iv: "03a3af0ec4b703c3dd0bd02ece696265"
server_key_version: "encryptionkey@0"
I20260809 03:27:10.697239 27087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "1428dadbe5224e12a18abe5b01100013"
format_stamp: "Formatted at 2026-08-09 03:27:10 on dist-test-slave-2w3w"
server_key: "396cd7c81f4980010abd8db168aaf46c"
server_key_iv: "03a3af0ec4b703c3dd0bd02ece696265"
server_key_version: "encryptionkey@0"
I20260809 03:27:10.698556 27087 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:27:10.699404 27104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:10.699609 27087 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 03:27:10.699715 27087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "1428dadbe5224e12a18abe5b01100013"
format_stamp: "Formatted at 2026-08-09 03:27:10 on dist-test-slave-2w3w"
server_key: "396cd7c81f4980010abd8db168aaf46c"
server_key_iv: "03a3af0ec4b703c3dd0bd02ece696265"
server_key_version: "encryptionkey@0"
I20260809 03:27:10.699786 27087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:10.724591 27087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:10.724931 27087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:10.725090 27087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:10.729367 27087 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:42919
I20260809 03:27:10.729405 27159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:42919 every 8 connection(s)
I20260809 03:27:10.729780 27087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:10.730756 27160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:10.731267 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 27087
I20260809 03:27:10.731400 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:10.731591 8215 external_mini_cluster.cc:1428] Setting key 1346fde23563aa2b2097a79b4280de46
I20260809 03:27:10.733623 27160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013: Bootstrap starting.
I20260809 03:27:10.734297 27160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:10.734616 27160 log.cc:824] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:10.735447 27160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013: No bootstrap required, opened a new log
I20260809 03:27:10.737313 27164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.732136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45294 (local address 127.8.5.254:42919)
0809 03:27:10.732328 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:10.732335 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:10.732360 (+ 25us) server_negotiation.cc:407] Connection header received
0809 03:27:10.732767 (+ 407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:10.732773 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:10.732838 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:10.732951 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:10.733202 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.734106 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.735321 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.735788 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.735887 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.736603 (+ 716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:10.736607 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:10.736607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:10.736813 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:10.736846 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:10.736857 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:10.736910 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:10.737016 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 03:27:10.737108 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":86,"threads_started":1}
I20260809 03:27:10.737828 27160 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1428dadbe5224e12a18abe5b01100013" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42919 } }
I20260809 03:27:10.737987 27160 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:10.738039 27160 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1428dadbe5224e12a18abe5b01100013, State: Initialized, Role: FOLLOWER
I20260809 03:27:10.738147 27160 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1428dadbe5224e12a18abe5b01100013" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42919 } }
I20260809 03:27:10.738206 27160 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:10.738227 27160 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:10.738267 27160 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:10.738765 27160 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1428dadbe5224e12a18abe5b01100013" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42919 } }
I20260809 03:27:10.738853 27160 leader_election.cc:302] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1428dadbe5224e12a18abe5b01100013; no voters:
I20260809 03:27:10.739025 27160 leader_election.cc:288] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:10.739100 27166 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:10.739254 27166 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013 [term 1 LEADER]: Becoming Leader. State: Replica: 1428dadbe5224e12a18abe5b01100013, State: Running, Role: LEADER
I20260809 03:27:10.739326 27160 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:10.739363 27166 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1428dadbe5224e12a18abe5b01100013" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42919 } }
I20260809 03:27:10.739771 27167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1428dadbe5224e12a18abe5b01100013" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1428dadbe5224e12a18abe5b01100013" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42919 } } }
I20260809 03:27:10.739804 27168 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1428dadbe5224e12a18abe5b01100013. Latest consensus state: current_term: 1 leader_uuid: "1428dadbe5224e12a18abe5b01100013" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1428dadbe5224e12a18abe5b01100013" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 42919 } } }
I20260809 03:27:10.739876 27167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:10.739882 27168 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:10.740111 27175 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:10.740809 27175 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:10.742467 27175 catalog_manager.cc:1347] Generated new cluster ID: fe8ac3a3acec49088d514f14e866574f
I20260809 03:27:10.742524 27175 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:10.754704 27175 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:10.755368 27175 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:10.766992 27175 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013: Generated new TSK 0
I20260809 03:27:10.767204 27175 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:10.768797 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:42919
--builtin_ntp_servers=127.8.5.212:37741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 03:27:10.851531 27187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:10.851724 27187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:10.851745 27187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:10.852875 27187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:10.852916 27187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:10.852947 27187 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:27:10.854326 27187 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:37741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:42919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:10.854564 27187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:10.854889 27187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:10.861081 27192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:10.861078 27195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:10.861074 27193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:10.861521 27187 server_base.cc:1034] running on GCE node
I20260809 03:27:10.861730 27187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:10.861963 27187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:10.863111 27187 hybrid_clock.cc:648] HybridClock initialized: now 1786246030863098 us; error 33 us; skew 500 ppm
I20260809 03:27:10.864676 27187 webserver.cc:460] Webserver started at http://127.8.5.193:33135/ using document root <none> and password file <none>
I20260809 03:27:10.865000 27187 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:10.865077 27187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:10.865226 27187 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:10.866701 27187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "91473633e67349e79cb9741df7fe2b02"
format_stamp: "Formatted at 2026-08-09 03:27:10 on dist-test-slave-2w3w"
server_key: "a91a6f50472d08d6e59c0f2caa20ff6b"
server_key_iv: "8b28e8e4d18870aa31ecd2c04f3aca06"
server_key_version: "encryptionkey@0"
I20260809 03:27:10.867151 27187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "91473633e67349e79cb9741df7fe2b02"
format_stamp: "Formatted at 2026-08-09 03:27:10 on dist-test-slave-2w3w"
server_key: "a91a6f50472d08d6e59c0f2caa20ff6b"
server_key_iv: "8b28e8e4d18870aa31ecd2c04f3aca06"
server_key_version: "encryptionkey@0"
I20260809 03:27:10.868816 27187 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 03:27:10.869720 27201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:10.869889 27187 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:10.870004 27187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "91473633e67349e79cb9741df7fe2b02"
format_stamp: "Formatted at 2026-08-09 03:27:10 on dist-test-slave-2w3w"
server_key: "a91a6f50472d08d6e59c0f2caa20ff6b"
server_key_iv: "8b28e8e4d18870aa31ecd2c04f3aca06"
server_key_version: "encryptionkey@0"
I20260809 03:27:10.870081 27187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:10.879053 27187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:10.879320 27187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:10.879464 27187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:10.879669 27187 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:27:10.879990 27187 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:27:10.880024 27187 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:10.880074 27187 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:27:10.880101 27187 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:10.885879 27187 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:37195
I20260809 03:27:10.885977 27322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:37195 every 8 connection(s)
I20260809 03:27:10.886291 27187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:27:10.891667 27164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.887105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:58531 (local address 127.8.5.254:42919)
0809 03:27:10.887186 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:10.887189 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:10.887434 (+ 245us) server_negotiation.cc:407] Connection header received
0809 03:27:10.887909 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:10.887910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:10.887923 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:10.887986 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:10.888809 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.889331 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.890309 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.890556 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.890612 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.891442 (+ 830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:10.891444 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:10.891444 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:10.891448 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:10.891461 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:10.891465 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:10.891514 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:10.891584 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 03:27:10.891607 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 03:27:10.891861 27325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:10.887071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:42919 (local address 127.8.5.193:58531)
0809 03:27:10.887300 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:10.887334 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:10.887813 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:10.888056 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:10.888059 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:10.888067 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:10.888686 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:10.888692 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.889424 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.889424 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:10.890218 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:10.890220 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:10.890632 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:10.890633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:10.890747 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:10.891302 (+ 555us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:27:10.891302 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:10.891330 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:27:10.891353 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:10.891517 (+ 164us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:10.891519 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:10.891521 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:27:10.891567 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 03:27:10.891646 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":116,"threads_started":1}
I20260809 03:27:10.892462 27323 heartbeater.cc:347] Connected to a master server at 127.8.5.254:42919
I20260809 03:27:10.892552 27323 heartbeater.cc:464] Registering TS with master...
I20260809 03:27:10.892695 27323 heartbeater.cc:511] Master 127.8.5.254:42919 requested a full tablet report, sending...
I20260809 03:27:10.893162 27122 ts_manager.cc:194] Registered new tserver with Master: 91473633e67349e79cb9741df7fe2b02 (127.8.5.193:37195)
I20260809 03:27:10.893729 27122 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.5.193:58531
I20260809 03:27:10.894490 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 27187
I20260809 03:27:10.894610 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:27:10.894877 8215 external_mini_cluster.cc:1428] Setting key 8330457a6d0722fccfb62506800ad541
I20260809 03:27:10.895975 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:42919
--builtin_ntp_servers=127.8.5.212:37741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 03:27:10.977799 27326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:10.978034 27326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:10.978071 27326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:10.979282 27326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:10.979338 27326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:10.979423 27326 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:27:10.980768 27326 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:37741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:42919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:10.981052 27326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:10.981359 27326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:10.986516 27335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:10.986608 27332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:10.986526 27331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:10.986756 27326 server_base.cc:1034] running on GCE node
I20260809 03:27:10.987036 27326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:10.987296 27326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:10.988451 27326 hybrid_clock.cc:648] HybridClock initialized: now 1786246030988441 us; error 31 us; skew 500 ppm
I20260809 03:27:10.989728 27326 webserver.cc:460] Webserver started at http://127.8.5.194:37535/ using document root <none> and password file <none>
I20260809 03:27:10.989993 27326 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:10.990057 27326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:10.990231 27326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:10.991477 27326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f"
format_stamp: "Formatted at 2026-08-09 03:27:10 on dist-test-slave-2w3w"
server_key: "5c3a3c5a876a9a4352fbf1fe7a70f522"
server_key_iv: "ce6d27781761970193c4b6afdcf3b719"
server_key_version: "encryptionkey@0"
I20260809 03:27:10.991835 27326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f"
format_stamp: "Formatted at 2026-08-09 03:27:10 on dist-test-slave-2w3w"
server_key: "5c3a3c5a876a9a4352fbf1fe7a70f522"
server_key_iv: "ce6d27781761970193c4b6afdcf3b719"
server_key_version: "encryptionkey@0"
I20260809 03:27:10.993155 27326 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:27:10.993902 27341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:10.994089 27326 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:27:10.994179 27326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f"
format_stamp: "Formatted at 2026-08-09 03:27:10 on dist-test-slave-2w3w"
server_key: "5c3a3c5a876a9a4352fbf1fe7a70f522"
server_key_iv: "ce6d27781761970193c4b6afdcf3b719"
server_key_version: "encryptionkey@0"
I20260809 03:27:10.994254 27326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:11.031201 27326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:11.031562 27326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:11.031708 27326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:11.031982 27326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:27:11.032353 27326 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:27:11.032407 27326 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:11.032442 27326 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:27:11.032469 27326 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:11.038302 27326 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:34353
I20260809 03:27:11.038349 27461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:34353 every 8 connection(s)
I20260809 03:27:11.038720 27326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:27:11.042114 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 27326
I20260809 03:27:11.042197 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:27:11.042411 8215 external_mini_cluster.cc:1428] Setting key 76101670ad40b06978d1dbd4505adf08
I20260809 03:27:11.043560 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:42919
--builtin_ntp_servers=127.8.5.212:37741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 03:27:11.044900 27164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.039609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:43553 (local address 127.8.5.254:42919)
0809 03:27:11.039675 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:11.039677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:11.039970 (+ 293us) server_negotiation.cc:407] Connection header received
0809 03:27:11.040514 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:11.040516 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:11.040530 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:11.040580 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:11.041317 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.041821 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.043062 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.043340 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.043423 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.044445 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:11.044447 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:11.044447 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:11.044452 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:11.044469 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:11.044473 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:11.044523 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:11.044695 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 03:27:11.044730 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 03:27:11.045246 27464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.039603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:42919 (local address 127.8.5.194:43553)
0809 03:27:11.039834 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:11.039869 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:11.040388 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:11.040656 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:11.040659 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:11.040666 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:11.041196 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:11.041200 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.041917 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.041918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:11.042917 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:11.042919 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.043444 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.043445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:11.043573 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.044215 (+ 642us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:27:11.044216 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:11.044245 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:27:11.044268 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:11.044551 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:11.044558 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:11.044561 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:27:11.044659 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 03:27:11.044777 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":77,"threads_started":1}
I20260809 03:27:11.045912 27462 heartbeater.cc:347] Connected to a master server at 127.8.5.254:42919
I20260809 03:27:11.046031 27462 heartbeater.cc:464] Registering TS with master...
I20260809 03:27:11.046218 27462 heartbeater.cc:511] Master 127.8.5.254:42919 requested a full tablet report, sending...
I20260809 03:27:11.046617 27122 ts_manager.cc:194] Registered new tserver with Master: f051a4ddc92b47ceaeb5fdb9a491ce1f (127.8.5.194:34353)
I20260809 03:27:11.047078 27122 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.5.194:43553
W20260809 03:27:11.130388 27465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:11.130626 27465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:11.130666 27465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:11.131822 27465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:11.131891 27465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:11.131932 27465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:27:11.133287 27465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:37741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:42919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:11.133558 27465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:11.133876 27465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:11.138854 27471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:11.138901 27474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:11.138936 27470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:11.139072 27465 server_base.cc:1034] running on GCE node
I20260809 03:27:11.139400 27465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:11.139655 27465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:11.140866 27465 hybrid_clock.cc:648] HybridClock initialized: now 1786246031140838 us; error 56 us; skew 500 ppm
I20260809 03:27:11.142174 27465 webserver.cc:460] Webserver started at http://127.8.5.195:38859/ using document root <none> and password file <none>
I20260809 03:27:11.142439 27465 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:11.142521 27465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:11.142671 27465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:11.143788 27465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "ab63320affa2445fabb1c2b755da8ee3"
format_stamp: "Formatted at 2026-08-09 03:27:11 on dist-test-slave-2w3w"
server_key: "5621bccefa6a14a3a879920db3832cef"
server_key_iv: "520188f742c9e49d8c0f200ed80e8533"
server_key_version: "encryptionkey@0"
I20260809 03:27:11.144145 27465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "ab63320affa2445fabb1c2b755da8ee3"
format_stamp: "Formatted at 2026-08-09 03:27:11 on dist-test-slave-2w3w"
server_key: "5621bccefa6a14a3a879920db3832cef"
server_key_iv: "520188f742c9e49d8c0f200ed80e8533"
server_key_version: "encryptionkey@0"
I20260809 03:27:11.145417 27465 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 03:27:11.146106 27481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:11.146263 27465 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:27:11.146360 27465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "ab63320affa2445fabb1c2b755da8ee3"
format_stamp: "Formatted at 2026-08-09 03:27:11 on dist-test-slave-2w3w"
server_key: "5621bccefa6a14a3a879920db3832cef"
server_key_iv: "520188f742c9e49d8c0f200ed80e8533"
server_key_version: "encryptionkey@0"
I20260809 03:27:11.146440 27465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:11.161513 27465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:11.161818 27465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:11.161985 27465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:11.162205 27465 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:27:11.162531 27465 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:27:11.162587 27465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:11.162629 27465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:27:11.162657 27465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:11.168462 27465 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:39181
I20260809 03:27:11.168512 27603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:39181 every 8 connection(s)
I20260809 03:27:11.168828 27465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:27:11.172976 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 27465
I20260809 03:27:11.173085 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:27:11.173323 8215 external_mini_cluster.cc:1428] Setting key 7c0b96e4d0403e898253b82799a906c5
I20260809 03:27:11.174372 27164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.169557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:54103 (local address 127.8.5.254:42919)
0809 03:27:11.169626 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:11.169627 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:11.169856 (+ 229us) server_negotiation.cc:407] Connection header received
0809 03:27:11.170399 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:11.170401 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:11.170413 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:11.170473 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:11.171155 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.171653 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.172651 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.172974 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.173044 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.174080 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:11.174081 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:11.174081 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:11.174086 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:11.174103 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:11.174107 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:11.174163 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:11.174257 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 03:27:11.174283 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 03:27:11.174616 27606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.169544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:42919 (local address 127.8.5.195:54103)
0809 03:27:11.169735 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:11.169768 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:11.170273 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:11.170544 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:11.170548 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:11.170555 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:11.171060 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:11.171065 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.171750 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.171751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:11.172550 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:11.172552 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.173105 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.173106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:11.173282 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.173919 (+ 637us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:27:11.173919 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:11.173947 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:27:11.173969 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:11.174173 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:11.174177 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:11.174179 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:27:11.174252 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 03:27:11.174383 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":77,"threads_started":1}
I20260809 03:27:11.175165 27604 heartbeater.cc:347] Connected to a master server at 127.8.5.254:42919
I20260809 03:27:11.175276 27604 heartbeater.cc:464] Registering TS with master...
I20260809 03:27:11.175470 27604 heartbeater.cc:511] Master 127.8.5.254:42919 requested a full tablet report, sending...
I20260809 03:27:11.175829 27122 ts_manager.cc:194] Registered new tserver with Master: ab63320affa2445fabb1c2b755da8ee3 (127.8.5.195:39181)
I20260809 03:27:11.176193 27122 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.5.195:54103
I20260809 03:27:11.185118 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:27:11.189247 27164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.186497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45304 (local address 127.8.5.254:42919)
0809 03:27:11.186571 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:11.186573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:11.186658 (+ 85us) server_negotiation.cc:407] Connection header received
0809 03:27:11.186697 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:11.186697 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:11.186707 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:11.186762 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:11.187011 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.187498 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.188219 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.188404 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.188454 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.189014 (+ 560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:11.189015 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:11.189015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:11.189019 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:11.189031 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:11.189035 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:11.189078 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:11.189120 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 03:27:11.189138 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 03:27:11.190683 27122 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45304:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:27:11.192399 27122 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:27:11.198797 27616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.194751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47284 (local address 127.8.5.195:39181)
0809 03:27:11.194954 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:11.194980 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:11.194991 (+ 11us) server_negotiation.cc:407] Connection header received
0809 03:27:11.195052 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:11.195055 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:11.195073 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:11.195154 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:11.195407 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.196548 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.197779 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.198397 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.198483 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.198576 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:11.198662 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 03:27:11.198700 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":89,"threads_started":1}
I20260809 03:27:11.198825 27614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.194472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:37195 (local address 127.0.0.1:43432)
0809 03:27:11.194644 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:11.194686 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:11.194768 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:11.195234 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:11.195237 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:11.195242 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:11.195330 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:11.195333 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.196311 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.196312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:11.197553 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:11.197556 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.198573 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.198574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:11.198642 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.198647 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 03:27:11.198678 (+ 31us) client_negotiation.cc:240] Negotiation successful
0809 03:27:11.198718 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":2,"thread_start_us":61,"threads_started":1}
I20260809 03:27:11.198817 27613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.194473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:39181 (local address 127.0.0.1:47284)
0809 03:27:11.194802 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:11.194814 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:11.194899 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:11.195234 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:11.195237 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:11.195239 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:11.195330 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:11.195333 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.196662 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.196663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:11.197702 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:11.197704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.198483 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.198484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:11.198559 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.198573 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 03:27:11.198649 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 03:27:11.198702 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":24,"thread_start_us":104,"threads_started":1}
I20260809 03:27:11.199018 27618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.194473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:34353 (local address 127.0.0.1:36964)
0809 03:27:11.195161 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:11.195170 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:11.195277 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:11.195485 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:11.195486 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:11.195487 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:11.195521 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:11.195522 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.196722 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.196723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:11.197805 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:11.197808 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.198770 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.198771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:11.198839 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.198843 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:27:11.198889 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 03:27:11.198923 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"mutex_wait_us":525,"thread_start_us":75,"threads_started":1}
I20260809 03:27:11.199162 27615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.194565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43432 (local address 127.8.5.193:37195)
0809 03:27:11.195059 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:11.195063 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:11.195073 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:27:11.195111 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:11.195113 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:11.195128 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:11.195416 (+ 288us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:11.195481 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.196214 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.197642 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.198468 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.198870 (+ 402us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.198987 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:11.199013 (+ 26us) server_negotiation.cc:299] Negotiation successful
0809 03:27:11.199058 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":122,"threads_started":1}
I20260809 03:27:11.199389 27617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.194762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36964 (local address 127.8.5.194:34353)
0809 03:27:11.195006 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:11.195011 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:11.195340 (+ 329us) server_negotiation.cc:407] Connection header received
0809 03:27:11.195394 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:11.195397 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:11.195412 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:11.195490 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:11.195578 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.196636 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.197909 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.198600 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.198656 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.198736 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:11.199168 (+ 432us) server_negotiation.cc:299] Negotiation successful
0809 03:27:11.199212 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":156,"threads_started":1}
I20260809 03:27:11.199898 27253 tablet_service.cc:1467] Processing CreateTablet for tablet 850f8aab60284ad39756bd19e5802eb4 (DEFAULT_TABLE table=test-table [id=20e9aa543667490ead1cb683962b49a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:27:11.200021 27391 tablet_service.cc:1467] Processing CreateTablet for tablet 850f8aab60284ad39756bd19e5802eb4 (DEFAULT_TABLE table=test-table [id=20e9aa543667490ead1cb683962b49a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:27:11.200022 27535 tablet_service.cc:1467] Processing CreateTablet for tablet 850f8aab60284ad39756bd19e5802eb4 (DEFAULT_TABLE table=test-table [id=20e9aa543667490ead1cb683962b49a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:27:11.200285 27253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 850f8aab60284ad39756bd19e5802eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:11.200363 27391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 850f8aab60284ad39756bd19e5802eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:11.200363 27535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 850f8aab60284ad39756bd19e5802eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:11.202948 27619 tablet_bootstrap.cc:492] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02: Bootstrap starting.
I20260809 03:27:11.203692 27620 tablet_bootstrap.cc:492] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f: Bootstrap starting.
I20260809 03:27:11.204042 27619 tablet_bootstrap.cc:654] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:11.204375 27620 tablet_bootstrap.cc:654] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:11.204387 27619 log.cc:824] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:11.204700 27620 log.cc:824] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:11.204739 27621 tablet_bootstrap.cc:492] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3: Bootstrap starting.
I20260809 03:27:11.205175 27619 tablet_bootstrap.cc:492] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02: No bootstrap required, opened a new log
I20260809 03:27:11.205271 27619 ts_tablet_manager.cc:1397] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 03:27:11.205310 27621 tablet_bootstrap.cc:654] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:11.205471 27620 tablet_bootstrap.cc:492] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f: No bootstrap required, opened a new log
I20260809 03:27:11.205546 27620 ts_tablet_manager.cc:1397] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:27:11.205665 27621 log.cc:824] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:11.206481 27621 tablet_bootstrap.cc:492] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3: No bootstrap required, opened a new log
I20260809 03:27:11.206544 27621 ts_tablet_manager.cc:1397] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:27:11.207583 27619 raft_consensus.cc:348] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91473633e67349e79cb9741df7fe2b02" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37195 } } peers { permanent_uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 34353 } } peers { permanent_uuid: "ab63320affa2445fabb1c2b755da8ee3" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 39181 } }
I20260809 03:27:11.207736 27619 raft_consensus.cc:374] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:11.207780 27619 raft_consensus.cc:729] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91473633e67349e79cb9741df7fe2b02, State: Initialized, Role: FOLLOWER
I20260809 03:27:11.207912 27619 consensus_queue.cc:260] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91473633e67349e79cb9741df7fe2b02" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37195 } } peers { permanent_uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 34353 } } peers { permanent_uuid: "ab63320affa2445fabb1c2b755da8ee3" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 39181 } }
I20260809 03:27:11.208179 27619 ts_tablet_manager.cc:1428] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 03:27:11.208165 27620 raft_consensus.cc:348] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91473633e67349e79cb9741df7fe2b02" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37195 } } peers { permanent_uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 34353 } } peers { permanent_uuid: "ab63320affa2445fabb1c2b755da8ee3" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 39181 } }
I20260809 03:27:11.208328 27620 raft_consensus.cc:374] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:11.208325 27323 heartbeater.cc:503] Master 127.8.5.254:42919 was elected leader, sending a full tablet report...
I20260809 03:27:11.208379 27620 raft_consensus.cc:729] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f051a4ddc92b47ceaeb5fdb9a491ce1f, State: Initialized, Role: FOLLOWER
I20260809 03:27:11.208492 27620 consensus_queue.cc:260] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91473633e67349e79cb9741df7fe2b02" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37195 } } peers { permanent_uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 34353 } } peers { permanent_uuid: "ab63320affa2445fabb1c2b755da8ee3" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 39181 } }
I20260809 03:27:11.208737 27620 ts_tablet_manager.cc:1428] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260809 03:27:11.208866 27462 heartbeater.cc:503] Master 127.8.5.254:42919 was elected leader, sending a full tablet report...
I20260809 03:27:11.209406 27621 raft_consensus.cc:348] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91473633e67349e79cb9741df7fe2b02" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37195 } } peers { permanent_uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 34353 } } peers { permanent_uuid: "ab63320affa2445fabb1c2b755da8ee3" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 39181 } }
I20260809 03:27:11.209554 27621 raft_consensus.cc:374] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:11.209576 27621 raft_consensus.cc:729] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab63320affa2445fabb1c2b755da8ee3, State: Initialized, Role: FOLLOWER
I20260809 03:27:11.209673 27621 consensus_queue.cc:260] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91473633e67349e79cb9741df7fe2b02" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37195 } } peers { permanent_uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 34353 } } peers { permanent_uuid: "ab63320affa2445fabb1c2b755da8ee3" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 39181 } }
I20260809 03:27:11.209883 27621 ts_tablet_manager.cc:1428] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 03:27:11.210016 27604 heartbeater.cc:503] Master 127.8.5.254:42919 was elected leader, sending a full tablet report...
I20260809 03:27:11.265254 27628 raft_consensus.cc:482] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:27:11.265388 27628 raft_consensus.cc:504] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91473633e67349e79cb9741df7fe2b02" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37195 } } peers { permanent_uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 34353 } } peers { permanent_uuid: "ab63320affa2445fabb1c2b755da8ee3" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 39181 } }
I20260809 03:27:11.265725 27628 leader_election.cc:288] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91473633e67349e79cb9741df7fe2b02 (127.8.5.193:37195), f051a4ddc92b47ceaeb5fdb9a491ce1f (127.8.5.194:34353)
I20260809 03:27:11.270004 27617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.266037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:41453 (local address 127.8.5.194:34353)
0809 03:27:11.266088 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:11.266090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:11.266201 (+ 111us) server_negotiation.cc:407] Connection header received
0809 03:27:11.266254 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:11.266255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:11.266268 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:11.266325 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:11.266489 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.267263 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.269005 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.269569 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.269650 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.269661 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:11.269883 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 03:27:11.269931 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 03:27:11.270004 27615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.266006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:48425 (local address 127.8.5.193:37195)
0809 03:27:11.266056 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:11.266059 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:11.266108 (+ 49us) server_negotiation.cc:407] Connection header received
0809 03:27:11.266144 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:11.266145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:11.266154 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:11.266227 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:11.266429 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.267233 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.269005 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.269595 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.269656 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.269664 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:11.269884 (+ 220us) server_negotiation.cc:299] Negotiation successful
0809 03:27:11.269931 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 03:27:11.269984 27606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.265921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:37195 (local address 127.8.5.195:48425)
0809 03:27:11.265997 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:11.266010 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:11.266054 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:11.266252 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:11.266253 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:11.266255 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:11.266349 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:11.266351 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.267378 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.267380 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:11.268892 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:11.268895 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.269670 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.269671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:11.269758 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.269804 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 03:27:11.269861 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 03:27:11.269895 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":88}
I20260809 03:27:11.269997 27629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.265939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:34353 (local address 127.8.5.195:41453)
0809 03:27:11.266124 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:11.266141 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:11.266183 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:11.266354 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:11.266354 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:11.266356 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:11.266416 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:11.266418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.267378 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.267380 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:11.268892 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:11.268895 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.269670 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.269671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:11.269758 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.269762 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:27:11.269824 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 03:27:11.269879 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":83,"thread_start_us":114,"threads_started":1}
I20260809 03:27:11.270648 27274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "850f8aab60284ad39756bd19e5802eb4" candidate_uuid: "ab63320affa2445fabb1c2b755da8ee3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91473633e67349e79cb9741df7fe2b02" is_pre_election: true
I20260809 03:27:11.270646 27412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "850f8aab60284ad39756bd19e5802eb4" candidate_uuid: "ab63320affa2445fabb1c2b755da8ee3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f" is_pre_election: true
I20260809 03:27:11.270819 27274 raft_consensus.cc:2454] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab63320affa2445fabb1c2b755da8ee3 in term 0.
I20260809 03:27:11.270819 27412 raft_consensus.cc:2454] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab63320affa2445fabb1c2b755da8ee3 in term 0.
I20260809 03:27:11.271015 27627 raft_consensus.cc:482] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:27:11.271085 27627 raft_consensus.cc:504] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91473633e67349e79cb9741df7fe2b02" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37195 } } peers { permanent_uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 34353 } } peers { permanent_uuid: "ab63320affa2445fabb1c2b755da8ee3" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 39181 } }
I20260809 03:27:11.271126 27485 leader_election.cc:302] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab63320affa2445fabb1c2b755da8ee3, f051a4ddc92b47ceaeb5fdb9a491ce1f; no voters:
I20260809 03:27:11.271273 27628 raft_consensus.cc:2781] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:27:11.271348 27628 raft_consensus.cc:482] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:27:11.271384 27628 raft_consensus.cc:3037] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:11.271410 27627 leader_election.cc:288] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91473633e67349e79cb9741df7fe2b02 (127.8.5.193:37195), ab63320affa2445fabb1c2b755da8ee3 (127.8.5.195:39181)
I20260809 03:27:11.272392 27628 raft_consensus.cc:504] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91473633e67349e79cb9741df7fe2b02" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37195 } } peers { permanent_uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 34353 } } peers { permanent_uuid: "ab63320affa2445fabb1c2b755da8ee3" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 39181 } }
I20260809 03:27:11.272616 27628 leader_election.cc:288] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [CANDIDATE]: Term 1 election: Requested vote from peers 91473633e67349e79cb9741df7fe2b02 (127.8.5.193:37195), f051a4ddc92b47ceaeb5fdb9a491ce1f (127.8.5.194:34353)
I20260809 03:27:11.272712 27274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "850f8aab60284ad39756bd19e5802eb4" candidate_uuid: "ab63320affa2445fabb1c2b755da8ee3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91473633e67349e79cb9741df7fe2b02"
I20260809 03:27:11.272818 27274 raft_consensus.cc:3037] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:11.273631 27274 raft_consensus.cc:2454] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab63320affa2445fabb1c2b755da8ee3 in term 1.
I20260809 03:27:11.273900 27484 leader_election.cc:302] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91473633e67349e79cb9741df7fe2b02, ab63320affa2445fabb1c2b755da8ee3; no voters:
I20260809 03:27:11.273975 27628 raft_consensus.cc:2781] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:11.273944 27412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "850f8aab60284ad39756bd19e5802eb4" candidate_uuid: "ab63320affa2445fabb1c2b755da8ee3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f"
I20260809 03:27:11.274012 27412 raft_consensus.cc:3037] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:11.274094 27628 raft_consensus.cc:686] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [term 1 LEADER]: Becoming Leader. State: Replica: ab63320affa2445fabb1c2b755da8ee3, State: Running, Role: LEADER
I20260809 03:27:11.274188 27628 consensus_queue.cc:237] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91473633e67349e79cb9741df7fe2b02" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37195 } } peers { permanent_uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 34353 } } peers { permanent_uuid: "ab63320affa2445fabb1c2b755da8ee3" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 39181 } }
I20260809 03:27:11.274883 27412 raft_consensus.cc:2454] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab63320affa2445fabb1c2b755da8ee3 in term 1.
I20260809 03:27:11.275094 27615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.271813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:36973 (local address 127.8.5.193:37195)
0809 03:27:11.271862 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:11.271865 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:11.271873 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:27:11.271928 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:11.271928 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:11.271938 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:11.271992 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:11.272137 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.272796 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.274144 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.274634 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.274681 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.274690 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:11.274978 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 03:27:11.275027 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 03:27:11.275188 27464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.271559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:39181 (local address 127.8.5.194:47805)
0809 03:27:11.271608 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:11.271618 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:11.271654 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:11.271832 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:11.271833 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:11.271835 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:11.271899 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:11.271901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.272811 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.272812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:11.274071 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:11.274074 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.274931 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.274932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:11.275019 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.275023 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:27:11.275073 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 03:27:11.275112 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":45}
I20260809 03:27:11.275336 27630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.271632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:37195 (local address 127.8.5.194:36973)
0809 03:27:11.271825 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:11.271834 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:11.271877 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:11.271994 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:11.271994 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:11.271996 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:11.272066 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:11.272067 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.272893 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.272893 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:11.274044 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:11.274046 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.274768 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.274769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:11.274858 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.274863 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 03:27:11.275194 (+ 331us) client_negotiation.cc:240] Negotiation successful
0809 03:27:11.275240 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":1,"thread_start_us":92,"threads_started":1}
I20260809 03:27:11.275133 27120 catalog_manager.cc:5495] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab63320affa2445fabb1c2b755da8ee3 (127.8.5.195). New cstate: current_term: 1 leader_uuid: "ab63320affa2445fabb1c2b755da8ee3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91473633e67349e79cb9741df7fe2b02" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 34353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab63320affa2445fabb1c2b755da8ee3" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 39181 } health_report { overall_health: HEALTHY } } }
I20260809 03:27:11.275523 27274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "850f8aab60284ad39756bd19e5802eb4" candidate_uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91473633e67349e79cb9741df7fe2b02" is_pre_election: true
I20260809 03:27:11.275614 27274 raft_consensus.cc:2379] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f051a4ddc92b47ceaeb5fdb9a491ce1f in current term 1: Already voted for candidate ab63320affa2445fabb1c2b755da8ee3 in this term.
I20260809 03:27:11.275806 27616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.271642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:47805 (local address 127.8.5.195:39181)
0809 03:27:11.271681 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:11.271684 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:11.271692 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:27:11.271715 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:11.271716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:11.271725 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:11.271786 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:11.271980 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.272702 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.274276 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.274800 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.274862 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.274873 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:11.275692 (+ 819us) server_negotiation.cc:299] Negotiation successful
0809 03:27:11.275735 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:27:11.276064 27555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "850f8aab60284ad39756bd19e5802eb4" candidate_uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab63320affa2445fabb1c2b755da8ee3" is_pre_election: true
I20260809 03:27:11.276376 27342 leader_election.cc:302] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f051a4ddc92b47ceaeb5fdb9a491ce1f; no voters: 91473633e67349e79cb9741df7fe2b02, ab63320affa2445fabb1c2b755da8ee3
I20260809 03:27:11.276495 27627 raft_consensus.cc:2726] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260809 03:27:11.289314 27463 tablet.cc:2369] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:27:11.293951 27616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.291759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47300 (local address 127.8.5.195:39181)
0809 03:27:11.291820 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:11.291822 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:11.291830 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:27:11.291908 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:11.291909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:11.291927 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:11.291987 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:27:11.292081 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.292533 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.293244 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:11.293426 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:11.293478 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:11.293602 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:27:11.293701 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:27:11.293763 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:11.293792 (+ 29us) server_negotiation.cc:299] Negotiation successful
0809 03:27:11.293808 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 03:27:11.295825 27274 raft_consensus.cc:1261] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02 [term 1 FOLLOWER]: Refusing update from remote peer ab63320affa2445fabb1c2b755da8ee3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:27:11.295853 27412 raft_consensus.cc:1261] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f [term 1 FOLLOWER]: Refusing update from remote peer ab63320affa2445fabb1c2b755da8ee3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:27:11.296165 27628 consensus_queue.cc:1035] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91473633e67349e79cb9741df7fe2b02" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 37195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:27:11.296334 27631 consensus_queue.cc:1035] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f051a4ddc92b47ceaeb5fdb9a491ce1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 34353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:27:11.299086 27635 mvcc.cc:205] Tried to move back new op lower bound from 7316463744185180160 to 7316463744099971072. Current Snapshot: MvccSnapshot[applied={T|T < 7316463744185180160}]
I20260809 03:27:11.301468 27122 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45304:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:27:11.301561 27122 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45304:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:27:11.302299 27122 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1428dadbe5224e12a18abe5b01100013: Sending DeleteTablet for 3 replicas of tablet 850f8aab60284ad39756bd19e5802eb4
I20260809 03:27:11.302664 27253 tablet_service.cc:1514] Processing DeleteTablet for tablet 850f8aab60284ad39756bd19e5802eb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:27:11 UTC) from {username='slave'} at 127.0.0.1:43432
I20260809 03:27:11.302696 27535 tablet_service.cc:1514] Processing DeleteTablet for tablet 850f8aab60284ad39756bd19e5802eb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:27:11 UTC) from {username='slave'} at 127.0.0.1:47284
I20260809 03:27:11.302944 27644 tablet_replica.cc:330] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02: stopping tablet replica
I20260809 03:27:11.303046 27391 tablet_service.cc:1514] Processing DeleteTablet for tablet 850f8aab60284ad39756bd19e5802eb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:27:11 UTC) from {username='slave'} at 127.0.0.1:36964
I20260809 03:27:11.303077 27644 raft_consensus.cc:2229] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:27:11.303179 27644 raft_consensus.cc:2258] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:27:11.303333 27643 tablet_replica.cc:330] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3: stopping tablet replica
I20260809 03:27:11.303426 27643 raft_consensus.cc:2229] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:27:11.303413 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 27187
I20260809 03:27:11.303514 27643 raft_consensus.cc:2258] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:27:11.303692 27644 ts_tablet_manager.cc:1905] T 850f8aab60284ad39756bd19e5802eb4 P 91473633e67349e79cb9741df7fe2b02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:27:11.304004 27645 tablet_replica.cc:330] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f: stopping tablet replica
I20260809 03:27:11.304108 27645 raft_consensus.cc:2229] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:27:11.304210 27645 raft_consensus.cc:2258] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:27:11.304970 27645 ts_tablet_manager.cc:1905] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:27:11.307071 27645 ts_tablet_manager.cc:1918] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:27:11.307139 27645 log.cc:1196] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/850f8aab60284ad39756bd19e5802eb4
I20260809 03:27:11.307134 27643 ts_tablet_manager.cc:1905] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:27:11.307407 27645 ts_tablet_manager.cc:1939] T 850f8aab60284ad39756bd19e5802eb4 P f051a4ddc92b47ceaeb5fdb9a491ce1f: Deleting consensus metadata
I20260809 03:27:11.308702 27643 ts_tablet_manager.cc:1918] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:27:11.308764 27643 log.cc:1196] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/850f8aab60284ad39756bd19e5802eb4
I20260809 03:27:11.309041 27643 ts_tablet_manager.cc:1939] T 850f8aab60284ad39756bd19e5802eb4 P ab63320affa2445fabb1c2b755da8ee3: Deleting consensus metadata
I20260809 03:27:11.309490 27105 catalog_manager.cc:4841] TS ab63320affa2445fabb1c2b755da8ee3 (127.8.5.195:39181): tablet 850f8aab60284ad39756bd19e5802eb4 (table test-table [id=20e9aa543667490ead1cb683962b49a2]) successfully deleted
I20260809 03:27:11.313153 27108 catalog_manager.cc:4841] TS f051a4ddc92b47ceaeb5fdb9a491ce1f (127.8.5.194:34353): tablet 850f8aab60284ad39756bd19e5802eb4 (table test-table [id=20e9aa543667490ead1cb683962b49a2]) successfully deleted
W20260809 03:27:11.313429 27107 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.5.193:37195 (error 108)
I20260809 03:27:11.313658 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 27326
I20260809 03:27:11.314579 27618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:11.313797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:37195 (local address 127.0.0.1:43434)
0809 03:27:11.314484 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:11.314535 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.193:37195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":660}
W20260809 03:27:11.316712 27107 catalog_manager.cc:4584] TS 91473633e67349e79cb9741df7fe2b02 (127.8.5.193:37195): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 850f8aab60284ad39756bd19e5802eb4: Network error: Client connection negotiation failed: client connection to 127.8.5.193:37195: connect: Connection refused (error 111)
I20260809 03:27:11.319427 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 27465
I20260809 03:27:11.325004 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 27087
2026-08-09T03:27:11Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (761 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:11 dist-test-slave-2w3w krb5kdc[27649](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:11 dist-test-slave-2w3w krb5kdc[27649](info): set up 2 sockets
Aug 09 03:27:11 dist-test-slave-2w3w krb5kdc[27649](info): commencing operation
krb5kdc: starting...
W20260809 03:27:12.387991 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:12 dist-test-slave-2w3w krb5kdc[27649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:27:12.510440 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:35071
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:38497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:35071
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:12.593895 27663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:12.594099 27663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:12.594121 27663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:12.595430 27663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:12.595471 27663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:12.595485 27663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:12.595498 27663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:12.595510 27663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:12.596994 27663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:38497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:35071
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:35071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:12.597235 27663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:12.597482 27663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:12.602450 27669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:12.602459 27668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:12.602690 27663 server_base.cc:1034] running on GCE node
W20260809 03:27:12.602743 27672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:12.603046 27663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:12.603354 27663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:12.610364 27663 hybrid_clock.cc:648] HybridClock initialized: now 1786246032610343 us; error 36 us; skew 500 ppm
Aug 09 03:27:12 dist-test-slave-2w3w krb5kdc[27649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246032, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:12.613641 27663 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:27:12.614104 27663 webserver.cc:460] Webserver started at http://127.8.5.254:39567/ using document root <none> and password file <none>
I20260809 03:27:12.614342 27663 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:12.614426 27663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:12.614579 27663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:12.615758 27663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "3cd86bc1a50b4fb283908a024bec21d1"
format_stamp: "Formatted at 2026-08-09 03:27:12 on dist-test-slave-2w3w"
server_key: "5480b7af82952a64a33a5179f2157294"
server_key_iv: "94d68023687b01f75a8f69998ab872ef"
server_key_version: "encryptionkey@0"
I20260809 03:27:12.616142 27663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "3cd86bc1a50b4fb283908a024bec21d1"
format_stamp: "Formatted at 2026-08-09 03:27:12 on dist-test-slave-2w3w"
server_key: "5480b7af82952a64a33a5179f2157294"
server_key_iv: "94d68023687b01f75a8f69998ab872ef"
server_key_version: "encryptionkey@0"
I20260809 03:27:12.617564 27663 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 03:27:12.618350 27680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:12.618556 27663 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:12.618635 27663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "3cd86bc1a50b4fb283908a024bec21d1"
format_stamp: "Formatted at 2026-08-09 03:27:12 on dist-test-slave-2w3w"
server_key: "5480b7af82952a64a33a5179f2157294"
server_key_iv: "94d68023687b01f75a8f69998ab872ef"
server_key_version: "encryptionkey@0"
I20260809 03:27:12.618723 27663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:12.627059 27663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:12.629297 27663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:12.629467 27663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:12.633502 27663 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:35071
I20260809 03:27:12.633548 27735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:35071 every 8 connection(s)
I20260809 03:27:12.633884 27663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:12.634977 27736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:12.635378 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 27663
I20260809 03:27:12.635499 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:12.635699 8215 external_mini_cluster.cc:1428] Setting key 7eaa9d85a8bf004e89107b53d83f58be
I20260809 03:27:12.638387 27736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1: Bootstrap starting.
I20260809 03:27:12.639171 27736 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:12.639518 27736 log.cc:824] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:12.640268 27736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1: No bootstrap required, opened a new log
Aug 09 03:27:12 dist-test-slave-2w3w krb5kdc[27649](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:12.643460 27736 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cd86bc1a50b4fb283908a024bec21d1" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35071 } }
I20260809 03:27:12.643639 27736 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:12.643685 27736 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cd86bc1a50b4fb283908a024bec21d1, State: Initialized, Role: FOLLOWER
I20260809 03:27:12.643818 27736 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cd86bc1a50b4fb283908a024bec21d1" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35071 } }
I20260809 03:27:12.643911 27736 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:12.643949 27736 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:12.644001 27736 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:12.644588 27736 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cd86bc1a50b4fb283908a024bec21d1" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35071 } }
I20260809 03:27:12.644708 27736 leader_election.cc:302] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3cd86bc1a50b4fb283908a024bec21d1; no voters:
I20260809 03:27:12.644884 27736 leader_election.cc:288] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:12.644927 27741 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:12.645056 27741 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1 [term 1 LEADER]: Becoming Leader. State: Replica: 3cd86bc1a50b4fb283908a024bec21d1, State: Running, Role: LEADER
I20260809 03:27:12.645169 27736 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:12.645151 27741 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cd86bc1a50b4fb283908a024bec21d1" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35071 } }
I20260809 03:27:12.645532 27741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3cd86bc1a50b4fb283908a024bec21d1. Latest consensus state: current_term: 1 leader_uuid: "3cd86bc1a50b4fb283908a024bec21d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cd86bc1a50b4fb283908a024bec21d1" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35071 } } }
I20260809 03:27:12.645612 27741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:12.645761 27742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3cd86bc1a50b4fb283908a024bec21d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cd86bc1a50b4fb283908a024bec21d1" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35071 } } }
I20260809 03:27:12.645910 27742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1 [sys.catalog]: This master's current role is: LEADER
W20260809 03:27:12.647243 27759 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:27:12.647322 27759 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:27:12.647372 27748 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:12.647531 27748 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:12.647857 27739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:12.636365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42984 (local address 127.8.5.254:35071)
0809 03:27:12.636528 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:12.636536 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:12.636569 (+ 33us) server_negotiation.cc:407] Connection header received
0809 03:27:12.636966 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:12.636972 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:12.637015 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:12.637172 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:12.637872 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:12.638815 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:12.639794 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:12.640451 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:12.640564 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:12.643529 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:12.643534 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:12.643534 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:12.643548 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:12.645741 (+ 2193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:12.646203 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:12.646206 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:12.646206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:12.646317 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:12.646554 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:12.646555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:12.646555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:12.646887 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:12.647057 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:12.647526 (+ 469us) server_negotiation.cc:299] Negotiation successful
0809 03:27:12.647669 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":78,"threads_started":1}
I20260809 03:27:12.649108 27748 catalog_manager.cc:1347] Generated new cluster ID: 7fb91630485549ff94eee4ff8327527b
I20260809 03:27:12.649164 27748 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:12.660842 27748 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:12.661365 27748 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:12.665352 27748 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1: Generated new TSK 0
I20260809 03:27:12.665524 27748 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
I20260809 03:27:12.694384 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:35071
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:38497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:12.776597 27764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:12.776822 27764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:12.776845 27764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:12.777959 27764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:12.777997 27764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:12.778023 27764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:27:12.779570 27764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:38497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:35071
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:12.779825 27764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:12.780053 27764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:12.785763 27771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:12.785790 27770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:12.785790 27773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:12.785941 27764 server_base.cc:1034] running on GCE node
I20260809 03:27:12.786211 27764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:12.786482 27764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:12.787662 27764 hybrid_clock.cc:648] HybridClock initialized: now 1786246032787642 us; error 36 us; skew 500 ppm
Aug 09 03:27:12 dist-test-slave-2w3w krb5kdc[27649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246032, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:12.790225 27764 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:27:12.790658 27764 webserver.cc:460] Webserver started at http://127.8.5.193:34049/ using document root <none> and password file <none>
I20260809 03:27:12.790845 27764 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:12.790884 27764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:12.791031 27764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:12.792042 27764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "9d400b11d974472ba93b0a73b40f637a"
format_stamp: "Formatted at 2026-08-09 03:27:12 on dist-test-slave-2w3w"
server_key: "3ffc57396210d9198ddba182e9c0b9e3"
server_key_iv: "41551d27bdb6f7c899e1039b4fe9b884"
server_key_version: "encryptionkey@0"
I20260809 03:27:12.792359 27764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "9d400b11d974472ba93b0a73b40f637a"
format_stamp: "Formatted at 2026-08-09 03:27:12 on dist-test-slave-2w3w"
server_key: "3ffc57396210d9198ddba182e9c0b9e3"
server_key_iv: "41551d27bdb6f7c899e1039b4fe9b884"
server_key_version: "encryptionkey@0"
I20260809 03:27:12.793622 27764 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:27:12.794332 27781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:12.794566 27764 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:12.794661 27764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "9d400b11d974472ba93b0a73b40f637a"
format_stamp: "Formatted at 2026-08-09 03:27:12 on dist-test-slave-2w3w"
server_key: "3ffc57396210d9198ddba182e9c0b9e3"
server_key_iv: "41551d27bdb6f7c899e1039b4fe9b884"
server_key_version: "encryptionkey@0"
I20260809 03:27:12.794755 27764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:12.804288 27764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:12.806149 27764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:12.806300 27764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:12.806551 27764 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:27:12.806893 27764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:27:12.806949 27764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:12.807025 27764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:27:12.807106 27764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:12.813002 27764 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:36389
I20260809 03:27:12.813046 27899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:36389 every 8 connection(s)
I20260809 03:27:12.813403 27764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
Aug 09 03:27:12 dist-test-slave-2w3w krb5kdc[27649](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246032, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:12.819869 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 27764
I20260809 03:27:12.819974 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:27:12.820223 8215 external_mini_cluster.cc:1428] Setting key 15d67d13483af333a7f18ba8c3ea93c9
I20260809 03:27:12.823472 27739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:12.814214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:39319 (local address 127.8.5.254:35071)
0809 03:27:12.814292 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:12.814294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:12.814485 (+ 191us) server_negotiation.cc:407] Connection header received
0809 03:27:12.815104 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:12.815106 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:12.815119 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:12.815174 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:12.816161 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:12.816660 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:12.817632 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:12.817843 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:12.817929 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:12.820280 (+ 2351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:12.820282 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:12.820282 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:12.820291 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:12.821770 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:12.822355 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:12.822357 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:12.822357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:12.822420 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:12.822714 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:12.822714 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:12.822715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:12.822816 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:12.822885 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:12.823252 (+ 367us) server_negotiation.cc:299] Negotiation successful
0809 03:27:12.823345 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 03:27:12.823676 27903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:12.814167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:35071 (local address 127.8.5.193:39319)
0809 03:27:12.814368 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:12.814406 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:12.814949 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:12.815249 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:12.815252 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:12.815851 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:12.816058 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:12.816062 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:12.816765 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:12.816766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:12.817542 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:12.817544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:12.817941 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:12.817942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:12.818079 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:12.818627 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:12.818636 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:12.820171 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:12.821859 (+ 1688us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:12.821867 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:12.821869 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:12.822229 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:12.822490 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:12.822491 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:12.822492 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:12.822646 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:12.822894 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:12.822900 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:12.823094 (+ 194us) client_negotiation.cc:769] Sending connection context
0809 03:27:12.823220 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 03:27:12.823389 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":95,"threads_started":1}
I20260809 03:27:12.824359 27900 heartbeater.cc:347] Connected to a master server at 127.8.5.254:35071
I20260809 03:27:12.824453 27900 heartbeater.cc:464] Registering TS with master...
I20260809 03:27:12.824651 27900 heartbeater.cc:511] Master 127.8.5.254:35071 requested a full tablet report, sending...
I20260809 03:27:12.825160 27698 ts_manager.cc:194] Registered new tserver with Master: 9d400b11d974472ba93b0a73b40f637a (127.8.5.193:36389)
I20260809 03:27:12.825750 27698 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:39319
WARNING: no policy specified for kudu/127.8.5.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
I20260809 03:27:12.847734 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:35071
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:38497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:12.929546 27907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:12.929764 27907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:12.929800 27907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:12.930927 27907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:12.931010 27907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:12.931058 27907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:27:12.932533 27907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:38497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:35071
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:12.932788 27907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:12.933017 27907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 03:27:12.938124 27907 server_base.cc:1034] running on GCE node
W20260809 03:27:12.938093 27916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:12.938120 27913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:12.938093 27914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:12.938505 27907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:12.938709 27907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:12.939847 27907 hybrid_clock.cc:648] HybridClock initialized: now 1786246032939833 us; error 29 us; skew 500 ppm
Aug 09 03:27:12 dist-test-slave-2w3w krb5kdc[27649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246032, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:12.942266 27907 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:27:12.942662 27907 webserver.cc:460] Webserver started at http://127.8.5.194:40001/ using document root <none> and password file <none>
I20260809 03:27:12.942857 27907 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:12.942903 27907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:12.943051 27907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:12.944042 27907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "2a4849d2cf594bc7b712ffc5cbb65b1f"
format_stamp: "Formatted at 2026-08-09 03:27:12 on dist-test-slave-2w3w"
server_key: "3774d73ca26af22f567e169dde4df208"
server_key_iv: "156bb0c8d31a2b1f012f5becc13f0f95"
server_key_version: "encryptionkey@0"
I20260809 03:27:12.944343 27907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "2a4849d2cf594bc7b712ffc5cbb65b1f"
format_stamp: "Formatted at 2026-08-09 03:27:12 on dist-test-slave-2w3w"
server_key: "3774d73ca26af22f567e169dde4df208"
server_key_iv: "156bb0c8d31a2b1f012f5becc13f0f95"
server_key_version: "encryptionkey@0"
I20260809 03:27:12.945643 27907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:27:12.946398 27923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:12.946682 27907 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:12.946772 27907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "2a4849d2cf594bc7b712ffc5cbb65b1f"
format_stamp: "Formatted at 2026-08-09 03:27:12 on dist-test-slave-2w3w"
server_key: "3774d73ca26af22f567e169dde4df208"
server_key_iv: "156bb0c8d31a2b1f012f5becc13f0f95"
server_key_version: "encryptionkey@0"
I20260809 03:27:12.946843 27907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:12.956436 27907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:12.958166 27907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:12.958320 27907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:12.958544 27907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:27:12.958847 27907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:27:12.958880 27907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:12.958900 27907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:27:12.958949 27907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:12.964828 27907 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:32843
I20260809 03:27:12.964921 28044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:32843 every 8 connection(s)
I20260809 03:27:12.965206 27907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
Aug 09 03:27:12 dist-test-slave-2w3w krb5kdc[27649](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246032, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:12.972589 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 27907
I20260809 03:27:12.972707 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:27:12.972913 8215 external_mini_cluster.cc:1428] Setting key 1d5efd168840d8057c543cb7f467d822
I20260809 03:27:12.975190 27739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:12.965969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:55547 (local address 127.8.5.254:35071)
0809 03:27:12.966018 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:12.966020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:12.966214 (+ 194us) server_negotiation.cc:407] Connection header received
0809 03:27:12.966666 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:12.966667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:12.966676 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:12.966734 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:12.967748 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:12.968263 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:12.969233 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:12.969413 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:12.969464 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:12.972011 (+ 2547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:12.972014 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:12.972018 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:12.972025 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:12.973708 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:12.974216 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:12.974216 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:12.974217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:12.974267 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:12.974544 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:12.974544 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:12.974545 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:12.974643 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:12.974693 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:12.975059 (+ 366us) server_negotiation.cc:299] Negotiation successful
0809 03:27:12.975127 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 03:27:12.975903 28047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:12.965912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:35071 (local address 127.8.5.194:55547)
0809 03:27:12.966080 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:12.966121 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:12.966585 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:12.966808 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:12.966811 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:12.967452 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:12.967637 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:12.967654 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:12.968350 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:12.968351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:12.969156 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:12.969159 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:12.969485 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:12.969486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:12.969579 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:12.970346 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:12.970356 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:12.971883 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:12.973784 (+ 1901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:12.973792 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:12.973794 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:12.974143 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:12.974331 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:12.974332 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:12.974332 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:12.974480 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:12.974706 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:12.974719 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:12.974896 (+ 177us) client_negotiation.cc:769] Sending connection context
0809 03:27:12.975042 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 03:27:12.975646 (+ 604us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":88,"threads_started":1}
I20260809 03:27:12.976408 28045 heartbeater.cc:347] Connected to a master server at 127.8.5.254:35071
I20260809 03:27:12.976519 28045 heartbeater.cc:464] Registering TS with master...
I20260809 03:27:12.976727 28045 heartbeater.cc:511] Master 127.8.5.254:35071 requested a full tablet report, sending...
I20260809 03:27:12.977103 27698 ts_manager.cc:194] Registered new tserver with Master: 2a4849d2cf594bc7b712ffc5cbb65b1f (127.8.5.194:32843)
I20260809 03:27:12.977641 27698 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:55547
WARNING: no policy specified for kudu/127.8.5.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
I20260809 03:27:13.001611 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:35071
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:38497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:13.084619 28050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:13.084805 28050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:13.084828 28050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:13.085887 28050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:13.085920 28050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:13.085945 28050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:27:13.087481 28050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:38497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:35071
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:13.087657 28050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:13.087826 28050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:13.092685 28055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:13.092661 28058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:13.092656 28056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:13.092833 28050 server_base.cc:1034] running on GCE node
I20260809 03:27:13.093025 28050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:13.093221 28050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:13.094379 28050 hybrid_clock.cc:648] HybridClock initialized: now 1786246033094366 us; error 28 us; skew 500 ppm
Aug 09 03:27:13 dist-test-slave-2w3w krb5kdc[27649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246033, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:13.096980 28050 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:27:13.097393 28050 webserver.cc:460] Webserver started at http://127.8.5.195:43733/ using document root <none> and password file <none>
I20260809 03:27:13.097616 28050 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:13.097684 28050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:13.097836 28050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:13.098904 28050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "8871e867cad54990835a042af4977234"
format_stamp: "Formatted at 2026-08-09 03:27:13 on dist-test-slave-2w3w"
server_key: "8dec4ac338d97646583327aee20ea56e"
server_key_iv: "0101082efd0133aacc9ac3fc2c63bc93"
server_key_version: "encryptionkey@0"
I20260809 03:27:13.099341 28050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "8871e867cad54990835a042af4977234"
format_stamp: "Formatted at 2026-08-09 03:27:13 on dist-test-slave-2w3w"
server_key: "8dec4ac338d97646583327aee20ea56e"
server_key_iv: "0101082efd0133aacc9ac3fc2c63bc93"
server_key_version: "encryptionkey@0"
I20260809 03:27:13.100637 28050 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:13.101389 28065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:13.101580 28050 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:27:13.101676 28050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "8871e867cad54990835a042af4977234"
format_stamp: "Formatted at 2026-08-09 03:27:13 on dist-test-slave-2w3w"
server_key: "8dec4ac338d97646583327aee20ea56e"
server_key_iv: "0101082efd0133aacc9ac3fc2c63bc93"
server_key_version: "encryptionkey@0"
I20260809 03:27:13.101758 28050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:13.109644 28050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:13.111954 28050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:13.112115 28050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:13.112341 28050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:27:13.112638 28050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:27:13.112689 28050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:13.112725 28050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:27:13.112751 28050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:13.118492 28050 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:42705
I20260809 03:27:13.118592 28184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:42705 every 8 connection(s)
I20260809 03:27:13.118885 28050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
Aug 09 03:27:13 dist-test-slave-2w3w krb5kdc[27649](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246033, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:13.126785 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 28050
I20260809 03:27:13.126875 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:27:13.127090 8215 external_mini_cluster.cc:1428] Setting key a7c660e912f35c6c72190d84c8248f44
I20260809 03:27:13.128612 27739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.119652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:41667 (local address 127.8.5.254:35071)
0809 03:27:13.119739 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:13.119742 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:13.119904 (+ 162us) server_negotiation.cc:407] Connection header received
0809 03:27:13.120392 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:13.120393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:13.120405 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:13.120469 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:13.121459 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.122199 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.123364 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.123574 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.123630 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.125704 (+ 2074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:13.125705 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:13.125706 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:13.125712 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:13.127193 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:13.127635 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:13.127636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:13.127637 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:13.127727 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:13.128014 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:13.128015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:13.128015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:13.128191 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:13.128263 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:13.128469 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 03:27:13.128542 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 03:27:13.128754 28187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.119610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:35071 (local address 127.8.5.195:41667)
0809 03:27:13.119783 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:13.119818 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:13.120290 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:13.120519 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:13.120522 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:13.121095 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:13.121338 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:13.121343 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.122327 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.122328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:13.123281 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:13.123283 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.123642 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.123643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:13.123736 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.124218 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:13.124226 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:13.125624 (+ 1398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:13.127299 (+ 1675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:13.127305 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:13.127306 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:13.127574 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:13.127802 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:13.127803 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:13.127803 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:13.127943 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:13.128241 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:13.128253 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:13.128373 (+ 120us) client_negotiation.cc:769] Sending connection context
0809 03:27:13.128456 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 03:27:13.128569 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":153,"threads_started":1}
I20260809 03:27:13.129261 28185 heartbeater.cc:347] Connected to a master server at 127.8.5.254:35071
I20260809 03:27:13.129343 28185 heartbeater.cc:464] Registering TS with master...
I20260809 03:27:13.129527 28185 heartbeater.cc:511] Master 127.8.5.254:35071 requested a full tablet report, sending...
I20260809 03:27:13.129925 27698 ts_manager.cc:194] Registered new tserver with Master: 8871e867cad54990835a042af4977234 (127.8.5.195:42705)
I20260809 03:27:13.130302 27698 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:41667
I20260809 03:27:13.139016 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:27:13.146593 27739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.140458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42992 (local address 127.8.5.254:35071)
0809 03:27:13.140513 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:13.140515 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:13.140643 (+ 128us) server_negotiation.cc:407] Connection header received
0809 03:27:13.140703 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:13.140703 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:13.140711 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:13.140767 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:13.141285 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.141760 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.142470 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.142636 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.142683 (+ 47us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.144066 (+ 1383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:13.144067 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:13.144068 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:13.144073 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:13.145300 (+ 1227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:13.145722 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:13.145723 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:13.145724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:13.145780 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:13.146032 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:13.146033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:13.146033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:13.146164 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:13.146281 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:13.146431 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 03:27:13.146493 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 03:27:13.148675 27698 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42992:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:27:13.150243 27698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:27:13.156749 28198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.152826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44514 (local address 127.8.5.194:32843)
0809 03:27:13.153043 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:13.153048 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:13.153058 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:27:13.153099 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:13.153101 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:13.153117 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:13.153206 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:13.153423 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.154552 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.155838 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.156326 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.156413 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.156474 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:13.156627 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 03:27:13.156669 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":111,"threads_started":1}
I20260809 03:27:13.156817 28194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.152537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:36389 (local address 127.0.0.1:53740)
0809 03:27:13.152788 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:13.152834 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:13.152896 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:13.153301 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:13.153302 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:13.153304 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:13.153360 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:13.153362 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.154315 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.154316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:13.155574 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:13.155577 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.156577 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.156579 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:13.156642 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.156646 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:27:13.156696 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 03:27:13.156730 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":52,"threads_started":1}
I20260809 03:27:13.156936 28196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.152495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:42705 (local address 127.0.0.1:58034)
0809 03:27:13.152788 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:13.152828 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:13.152896 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:13.153520 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:13.153520 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:13.153523 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:13.153558 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:13.153559 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.154710 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.154712 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:13.155733 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:13.155735 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.156599 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.156600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:13.156650 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.156655 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 03:27:13.156684 (+ 29us) client_negotiation.cc:240] Negotiation successful
0809 03:27:13.156726 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":67,"threads_started":1}
I20260809 03:27:13.156738 28193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.152703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:32843 (local address 127.0.0.1:44514)
0809 03:27:13.152888 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:13.152900 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:13.152957 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:13.153223 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:13.153226 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:13.153228 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:13.153304 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:13.153306 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.154653 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.154654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:13.155757 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:13.155758 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.156413 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.156414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:13.156492 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.156506 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 03:27:13.156607 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 03:27:13.156662 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":23,"thread_start_us":32,"threads_started":1}
I20260809 03:27:13.157114 28197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.152668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53740 (local address 127.8.5.193:36389)
0809 03:27:13.153052 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:13.153055 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:13.153064 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:27:13.153095 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:13.153097 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:13.153130 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:13.153217 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:13.153458 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.154214 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.155660 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.156407 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.156480 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.156540 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:13.156957 (+ 417us) server_negotiation.cc:299] Negotiation successful
0809 03:27:13.157009 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":121,"threads_started":1}
I20260809 03:27:13.157713 28195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.152603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58034 (local address 127.8.5.195:42705)
0809 03:27:13.153342 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:13.153346 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:13.153356 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:27:13.153414 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:13.153416 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:13.153431 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:13.153509 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:13.153619 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.154629 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.155827 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.156511 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.156779 (+ 268us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.157559 (+ 780us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:13.157598 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 03:27:13.157635 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":702,"thread_start_us":87,"threads_started":1}
I20260809 03:27:13.157686 27975 tablet_service.cc:1467] Processing CreateTablet for tablet 83a0f8227d7b486180e5827d6bcf5f92 (DEFAULT_TABLE table=test-table [id=4a517df79d6346ccb6a621a4f0893e71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:27:13.157756 27831 tablet_service.cc:1467] Processing CreateTablet for tablet 83a0f8227d7b486180e5827d6bcf5f92 (DEFAULT_TABLE table=test-table [id=4a517df79d6346ccb6a621a4f0893e71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:27:13.158058 27975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83a0f8227d7b486180e5827d6bcf5f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:13.158128 27831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83a0f8227d7b486180e5827d6bcf5f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:13.160779 28200 tablet_bootstrap.cc:492] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f: Bootstrap starting.
I20260809 03:27:13.161270 28116 tablet_service.cc:1467] Processing CreateTablet for tablet 83a0f8227d7b486180e5827d6bcf5f92 (DEFAULT_TABLE table=test-table [id=4a517df79d6346ccb6a621a4f0893e71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:27:13.161489 28200 tablet_bootstrap.cc:654] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:13.161600 28116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83a0f8227d7b486180e5827d6bcf5f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:13.162119 28200 log.cc:824] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:13.162468 28199 tablet_bootstrap.cc:492] T 83a0f8227d7b486180e5827d6bcf5f92 P 9d400b11d974472ba93b0a73b40f637a: Bootstrap starting.
I20260809 03:27:13.162835 28200 tablet_bootstrap.cc:492] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f: No bootstrap required, opened a new log
I20260809 03:27:13.162930 28200 ts_tablet_manager.cc:1397] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:27:13.163141 28199 tablet_bootstrap.cc:654] T 83a0f8227d7b486180e5827d6bcf5f92 P 9d400b11d974472ba93b0a73b40f637a: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:13.163698 28199 log.cc:824] T 83a0f8227d7b486180e5827d6bcf5f92 P 9d400b11d974472ba93b0a73b40f637a: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:13.164515 28199 tablet_bootstrap.cc:492] T 83a0f8227d7b486180e5827d6bcf5f92 P 9d400b11d974472ba93b0a73b40f637a: No bootstrap required, opened a new log
I20260809 03:27:13.164588 28199 ts_tablet_manager.cc:1397] T 83a0f8227d7b486180e5827d6bcf5f92 P 9d400b11d974472ba93b0a73b40f637a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:27:13.164666 28200 raft_consensus.cc:348] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8871e867cad54990835a042af4977234" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42705 } } peers { permanent_uuid: "9d400b11d974472ba93b0a73b40f637a" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 36389 } } peers { permanent_uuid: "2a4849d2cf594bc7b712ffc5cbb65b1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 32843 } }
I20260809 03:27:13.164848 28200 raft_consensus.cc:374] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:13.164891 28200 raft_consensus.cc:729] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4849d2cf594bc7b712ffc5cbb65b1f, State: Initialized, Role: FOLLOWER
I20260809 03:27:13.165004 28200 consensus_queue.cc:260] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8871e867cad54990835a042af4977234" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42705 } } peers { permanent_uuid: "9d400b11d974472ba93b0a73b40f637a" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 36389 } } peers { permanent_uuid: "2a4849d2cf594bc7b712ffc5cbb65b1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 32843 } }
I20260809 03:27:13.165155 28203 tablet_bootstrap.cc:492] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234: Bootstrap starting.
I20260809 03:27:13.165303 28200 ts_tablet_manager.cc:1428] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 03:27:13.165429 28045 heartbeater.cc:503] Master 127.8.5.254:35071 was elected leader, sending a full tablet report...
I20260809 03:27:13.165788 28203 tablet_bootstrap.cc:654] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:13.166349 28203 log.cc:824] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:13.166738 28199 raft_consensus.cc:348] T 83a0f8227d7b486180e5827d6bcf5f92 P 9d400b11d974472ba93b0a73b40f637a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8871e867cad54990835a042af4977234" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42705 } } peers { permanent_uuid: "9d400b11d974472ba93b0a73b40f637a" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 36389 } } peers { permanent_uuid: "2a4849d2cf594bc7b712ffc5cbb65b1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 32843 } }
I20260809 03:27:13.166922 28199 raft_consensus.cc:374] T 83a0f8227d7b486180e5827d6bcf5f92 P 9d400b11d974472ba93b0a73b40f637a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:13.166999 28199 raft_consensus.cc:729] T 83a0f8227d7b486180e5827d6bcf5f92 P 9d400b11d974472ba93b0a73b40f637a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d400b11d974472ba93b0a73b40f637a, State: Initialized, Role: FOLLOWER
I20260809 03:27:13.167119 28199 consensus_queue.cc:260] T 83a0f8227d7b486180e5827d6bcf5f92 P 9d400b11d974472ba93b0a73b40f637a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8871e867cad54990835a042af4977234" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42705 } } peers { permanent_uuid: "9d400b11d974472ba93b0a73b40f637a" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 36389 } } peers { permanent_uuid: "2a4849d2cf594bc7b712ffc5cbb65b1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 32843 } }
I20260809 03:27:13.167177 28203 tablet_bootstrap.cc:492] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234: No bootstrap required, opened a new log
I20260809 03:27:13.167234 28203 ts_tablet_manager.cc:1397] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:27:13.167403 28199 ts_tablet_manager.cc:1428] T 83a0f8227d7b486180e5827d6bcf5f92 P 9d400b11d974472ba93b0a73b40f637a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 03:27:13.167532 27900 heartbeater.cc:503] Master 127.8.5.254:35071 was elected leader, sending a full tablet report...
I20260809 03:27:13.168776 28203 raft_consensus.cc:348] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8871e867cad54990835a042af4977234" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42705 } } peers { permanent_uuid: "9d400b11d974472ba93b0a73b40f637a" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 36389 } } peers { permanent_uuid: "2a4849d2cf594bc7b712ffc5cbb65b1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 32843 } }
I20260809 03:27:13.168913 28203 raft_consensus.cc:374] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:13.168936 28203 raft_consensus.cc:729] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8871e867cad54990835a042af4977234, State: Initialized, Role: FOLLOWER
I20260809 03:27:13.169065 28203 consensus_queue.cc:260] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8871e867cad54990835a042af4977234" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42705 } } peers { permanent_uuid: "9d400b11d974472ba93b0a73b40f637a" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 36389 } } peers { permanent_uuid: "2a4849d2cf594bc7b712ffc5cbb65b1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 32843 } }
I20260809 03:27:13.169325 28203 ts_tablet_manager.cc:1428] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 03:27:13.169335 28185 heartbeater.cc:503] Master 127.8.5.254:35071 was elected leader, sending a full tablet report...
W20260809 03:27:13.215775 28046 tablet.cc:2369] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 03:27:13.314230 27902 tablet.cc:2369] T 83a0f8227d7b486180e5827d6bcf5f92 P 9d400b11d974472ba93b0a73b40f637a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:27:13.330914 28207 raft_consensus.cc:482] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:27:13.331079 28207 raft_consensus.cc:504] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8871e867cad54990835a042af4977234" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42705 } } peers { permanent_uuid: "9d400b11d974472ba93b0a73b40f637a" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 36389 } } peers { permanent_uuid: "2a4849d2cf594bc7b712ffc5cbb65b1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 32843 } }
I20260809 03:27:13.331494 28207 leader_election.cc:288] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d400b11d974472ba93b0a73b40f637a (127.8.5.193:36389), 2a4849d2cf594bc7b712ffc5cbb65b1f (127.8.5.194:32843)
I20260809 03:27:13.334401 28187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.331716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:36389 (local address 127.8.5.195:47843)
0809 03:27:13.331773 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:13.331791 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:13.331893 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:13.332101 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:13.332102 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:13.332103 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:13.332161 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:13.332163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.332813 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.332814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:13.333565 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:13.333567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.334124 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.334125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:13.334207 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.334211 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:27:13.334269 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 03:27:13.334317 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":24}
I20260809 03:27:13.334420 28197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.331786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:47843 (local address 127.8.5.193:36389)
0809 03:27:13.331845 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:13.331847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:13.331873 (+ 26us) server_negotiation.cc:407] Connection header received
0809 03:27:13.331975 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:13.331977 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:13.331989 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:13.332056 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:13.332239 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.332725 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.333658 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.334044 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.334116 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.334128 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:13.334285 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 03:27:13.334341 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 03:27:13.334626 28208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.331879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:32843 (local address 127.8.5.195:44577)
0809 03:27:13.332023 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:13.332034 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:13.332082 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:13.332208 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:13.332209 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:13.332210 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:13.332288 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:13.332290 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.332924 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.332925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:13.333672 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:13.333674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.334395 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.334396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:13.334464 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.334468 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:27:13.334524 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 03:27:13.334559 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":96,"threads_started":1}
I20260809 03:27:13.334626 28198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.331975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:44577 (local address 127.8.5.194:32843)
0809 03:27:13.332040 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:13.332041 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:13.332071 (+ 30us) server_negotiation.cc:407] Connection header received
0809 03:27:13.332135 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:13.332135 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:13.332146 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:13.332203 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:13.332369 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.332838 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.333762 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.334286 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.334354 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.334363 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:13.334531 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 03:27:13.334567 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 03:27:13.334851 27851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83a0f8227d7b486180e5827d6bcf5f92" candidate_uuid: "8871e867cad54990835a042af4977234" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d400b11d974472ba93b0a73b40f637a" is_pre_election: true
I20260809 03:27:13.334901 27996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83a0f8227d7b486180e5827d6bcf5f92" candidate_uuid: "8871e867cad54990835a042af4977234" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4849d2cf594bc7b712ffc5cbb65b1f" is_pre_election: true
I20260809 03:27:13.335036 27996 raft_consensus.cc:2454] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8871e867cad54990835a042af4977234 in term 0.
I20260809 03:27:13.335035 27851 raft_consensus.cc:2454] T 83a0f8227d7b486180e5827d6bcf5f92 P 9d400b11d974472ba93b0a73b40f637a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8871e867cad54990835a042af4977234 in term 0.
I20260809 03:27:13.335255 28067 leader_election.cc:302] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8871e867cad54990835a042af4977234, 9d400b11d974472ba93b0a73b40f637a; no voters:
I20260809 03:27:13.335423 28207 raft_consensus.cc:2781] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:27:13.335503 28207 raft_consensus.cc:482] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:27:13.335520 28207 raft_consensus.cc:3037] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:13.336241 28207 raft_consensus.cc:504] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8871e867cad54990835a042af4977234" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42705 } } peers { permanent_uuid: "9d400b11d974472ba93b0a73b40f637a" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 36389 } } peers { permanent_uuid: "2a4849d2cf594bc7b712ffc5cbb65b1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 32843 } }
I20260809 03:27:13.336369 28207 leader_election.cc:288] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [CANDIDATE]: Term 1 election: Requested vote from peers 9d400b11d974472ba93b0a73b40f637a (127.8.5.193:36389), 2a4849d2cf594bc7b712ffc5cbb65b1f (127.8.5.194:32843)
I20260809 03:27:13.336519 27851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83a0f8227d7b486180e5827d6bcf5f92" candidate_uuid: "8871e867cad54990835a042af4977234" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d400b11d974472ba93b0a73b40f637a"
I20260809 03:27:13.336535 27996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83a0f8227d7b486180e5827d6bcf5f92" candidate_uuid: "8871e867cad54990835a042af4977234" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4849d2cf594bc7b712ffc5cbb65b1f"
I20260809 03:27:13.336619 27851 raft_consensus.cc:3037] T 83a0f8227d7b486180e5827d6bcf5f92 P 9d400b11d974472ba93b0a73b40f637a [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:13.336620 27996 raft_consensus.cc:3037] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:13.337364 27996 raft_consensus.cc:2454] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8871e867cad54990835a042af4977234 in term 1.
I20260809 03:27:13.337471 27851 raft_consensus.cc:2454] T 83a0f8227d7b486180e5827d6bcf5f92 P 9d400b11d974472ba93b0a73b40f637a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8871e867cad54990835a042af4977234 in term 1.
I20260809 03:27:13.337530 28067 leader_election.cc:302] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4849d2cf594bc7b712ffc5cbb65b1f, 8871e867cad54990835a042af4977234; no voters:
I20260809 03:27:13.337605 28207 raft_consensus.cc:2781] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:13.337765 28207 raft_consensus.cc:686] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [term 1 LEADER]: Becoming Leader. State: Replica: 8871e867cad54990835a042af4977234, State: Running, Role: LEADER
I20260809 03:27:13.338008 28207 consensus_queue.cc:237] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8871e867cad54990835a042af4977234" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42705 } } peers { permanent_uuid: "9d400b11d974472ba93b0a73b40f637a" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 36389 } } peers { permanent_uuid: "2a4849d2cf594bc7b712ffc5cbb65b1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 32843 } }
I20260809 03:27:13.338920 27697 catalog_manager.cc:5495] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8871e867cad54990835a042af4977234 (127.8.5.195). New cstate: current_term: 1 leader_uuid: "8871e867cad54990835a042af4977234" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8871e867cad54990835a042af4977234" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d400b11d974472ba93b0a73b40f637a" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 36389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4849d2cf594bc7b712ffc5cbb65b1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 32843 } health_report { overall_health: UNKNOWN } } }
W20260809 03:27:13.369483 28186 tablet.cc:2369] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:27:13.383932 28195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.381471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58048 (local address 127.8.5.195:42705)
0809 03:27:13.381522 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:13.381524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:13.381535 (+ 11us) server_negotiation.cc:407] Connection header received
0809 03:27:13.381578 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:13.381579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:13.381602 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:13.381687 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:27:13.381830 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.382302 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.383149 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.383373 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.383445 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.383577 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:27:13.383673 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:27:13.383779 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:13.383815 (+ 36us) server_negotiation.cc:299] Negotiation successful
0809 03:27:13.383826 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 03:27:13.385664 27851 raft_consensus.cc:1261] T 83a0f8227d7b486180e5827d6bcf5f92 P 9d400b11d974472ba93b0a73b40f637a [term 1 FOLLOWER]: Refusing update from remote peer 8871e867cad54990835a042af4977234: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:27:13.385689 27996 raft_consensus.cc:1261] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f [term 1 FOLLOWER]: Refusing update from remote peer 8871e867cad54990835a042af4977234: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:27:13.386078 28207 consensus_queue.cc:1035] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4849d2cf594bc7b712ffc5cbb65b1f" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:27:13.386229 28209 consensus_queue.cc:1035] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d400b11d974472ba93b0a73b40f637a" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 36389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:27:13.388737 28213 mvcc.cc:205] Tried to move back new op lower bound from 7316463752744873984 to 7316463752553246720. Current Snapshot: MvccSnapshot[applied={T|T < 7316463752744873984}]
I20260809 03:27:13.391124 27697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42992:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:27:13.391214 27697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42992:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:27:13.392020 27697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3cd86bc1a50b4fb283908a024bec21d1: Sending DeleteTablet for 3 replicas of tablet 83a0f8227d7b486180e5827d6bcf5f92
I20260809 03:27:13.392338 27831 tablet_service.cc:1514] Processing DeleteTablet for tablet 83a0f8227d7b486180e5827d6bcf5f92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:27:13 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:53740
I20260809 03:27:13.392441 28116 tablet_service.cc:1514] Processing DeleteTablet for tablet 83a0f8227d7b486180e5827d6bcf5f92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:27:13 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:58034
I20260809 03:27:13.392688 28224 tablet_replica.cc:330] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234: stopping tablet replica
I20260809 03:27:13.392700 27975 tablet_service.cc:1514] Processing DeleteTablet for tablet 83a0f8227d7b486180e5827d6bcf5f92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:27:13 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:44514
I20260809 03:27:13.392810 28223 tablet_replica.cc:330] T 83a0f8227d7b486180e5827d6bcf5f92 P 9d400b11d974472ba93b0a73b40f637a: stopping tablet replica
I20260809 03:27:13.392903 28224 raft_consensus.cc:2229] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:27:13.392921 28223 raft_consensus.cc:2229] T 83a0f8227d7b486180e5827d6bcf5f92 P 9d400b11d974472ba93b0a73b40f637a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:27:13.393002 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 27764
I20260809 03:27:13.393023 28223 raft_consensus.cc:2258] T 83a0f8227d7b486180e5827d6bcf5f92 P 9d400b11d974472ba93b0a73b40f637a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:27:13.393589 28224 raft_consensus.cc:2258] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:27:13.396883 28225 tablet_replica.cc:330] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f: stopping tablet replica
I20260809 03:27:13.397012 28225 raft_consensus.cc:2229] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:27:13.397115 28225 raft_consensus.cc:2258] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:27:13.397594 28225 ts_tablet_manager.cc:1905] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:27:13.399147 28225 ts_tablet_manager.cc:1918] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:27:13.399233 28225 log.cc:1196] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/83a0f8227d7b486180e5827d6bcf5f92
I20260809 03:27:13.399549 28225 ts_tablet_manager.cc:1939] T 83a0f8227d7b486180e5827d6bcf5f92 P 2a4849d2cf594bc7b712ffc5cbb65b1f: Deleting consensus metadata
I20260809 03:27:13.399679 28224 ts_tablet_manager.cc:1905] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:27:13.400059 27682 catalog_manager.cc:4841] TS 2a4849d2cf594bc7b712ffc5cbb65b1f (127.8.5.194:32843): tablet 83a0f8227d7b486180e5827d6bcf5f92 (table test-table [id=4a517df79d6346ccb6a621a4f0893e71]) successfully deleted
I20260809 03:27:13.401104 28224 ts_tablet_manager.cc:1918] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:27:13.401197 28224 log.cc:1196] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/83a0f8227d7b486180e5827d6bcf5f92
I20260809 03:27:13.401484 28224 ts_tablet_manager.cc:1939] T 83a0f8227d7b486180e5827d6bcf5f92 P 8871e867cad54990835a042af4977234: Deleting consensus metadata
I20260809 03:27:13.401850 27683 catalog_manager.cc:4841] TS 8871e867cad54990835a042af4977234 (127.8.5.195:42705): tablet 83a0f8227d7b486180e5827d6bcf5f92 (table test-table [id=4a517df79d6346ccb6a621a4f0893e71]) successfully deleted
W20260809 03:27:13.405283 27682 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.5.193:36389 (error 108)
I20260809 03:27:13.405767 28193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.405631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:36389 (local address 127.0.0.1:53756)
0809 03:27:13.405689 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:13.405731 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.193:36389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 03:27:13.405766 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 27907
W20260809 03:27:13.410161 27682 catalog_manager.cc:4584] TS 9d400b11d974472ba93b0a73b40f637a (127.8.5.193:36389): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 83a0f8227d7b486180e5827d6bcf5f92: Network error: Client connection negotiation failed: client connection to 127.8.5.193:36389: connect: Connection refused (error 111)
I20260809 03:27:13.417822 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 28050
I20260809 03:27:13.423830 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 27663
2026-08-09T03:27:13Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2097 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T03:27:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:13Z Disabled control of system clock
I20260809 03:27:13.452790 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:39245
--webserver_interface=127.8.5.254
--webserver_port=0
--builtin_ntp_servers=127.8.5.212:37443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:39245
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 03:27:13.532757 28230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:13.532963 28230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:13.532984 28230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:13.534119 28230 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:13.534161 28230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:13.534175 28230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:13.534188 28230 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:13.534240 28230 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:13.535629 28230 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:37443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:39245
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:39245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:13.535871 28230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:13.536158 28230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:13.540910 28239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:13.540891 28236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:13.540910 28237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:13.541226 28230 server_base.cc:1034] running on GCE node
I20260809 03:27:13.541474 28230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:13.541769 28230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:13.542922 28230 hybrid_clock.cc:648] HybridClock initialized: now 1786246033542908 us; error 30 us; skew 500 ppm
I20260809 03:27:13.549104 28230 webserver.cc:460] Webserver started at http://127.8.5.254:43679/ using document root <none> and password file <none>
I20260809 03:27:13.549378 28230 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:13.549429 28230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:13.549605 28230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:13.550693 28230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "5c8000bcdd0f4f5792c591876996cb9a"
format_stamp: "Formatted at 2026-08-09 03:27:13 on dist-test-slave-2w3w"
server_key: "4fedafa0680e5c02e13b4b6bf275320e"
server_key_iv: "3990e86e6032a1232f59b705a1fa09a8"
server_key_version: "encryptionkey@0"
I20260809 03:27:13.551110 28230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "5c8000bcdd0f4f5792c591876996cb9a"
format_stamp: "Formatted at 2026-08-09 03:27:13 on dist-test-slave-2w3w"
server_key: "4fedafa0680e5c02e13b4b6bf275320e"
server_key_iv: "3990e86e6032a1232f59b705a1fa09a8"
server_key_version: "encryptionkey@0"
I20260809 03:27:13.552372 28230 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:13.553076 28245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:13.553256 28230 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:27:13.553344 28230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "5c8000bcdd0f4f5792c591876996cb9a"
format_stamp: "Formatted at 2026-08-09 03:27:13 on dist-test-slave-2w3w"
server_key: "4fedafa0680e5c02e13b4b6bf275320e"
server_key_iv: "3990e86e6032a1232f59b705a1fa09a8"
server_key_version: "encryptionkey@0"
I20260809 03:27:13.553423 28230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:13.566833 28230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:13.567164 28230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:13.567315 28230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:13.571105 28230 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:39245
I20260809 03:27:13.571135 28300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:39245 every 8 connection(s)
I20260809 03:27:13.571457 28230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:13.572371 28301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:13.574594 28301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a: Bootstrap starting.
I20260809 03:27:13.575260 28301 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:13.575559 28301 log.cc:824] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:13.576210 28301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a: No bootstrap required, opened a new log
I20260809 03:27:13.577169 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 28230
I20260809 03:27:13.577286 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:13.577494 8215 external_mini_cluster.cc:1428] Setting key 65c7858a42247628cb116141d85f1824
I20260809 03:27:13.578425 28301 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c8000bcdd0f4f5792c591876996cb9a" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 39245 } }
I20260809 03:27:13.578588 28301 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:13.578629 28301 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8000bcdd0f4f5792c591876996cb9a, State: Initialized, Role: FOLLOWER
I20260809 03:27:13.578760 28301 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c8000bcdd0f4f5792c591876996cb9a" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 39245 } }
I20260809 03:27:13.578851 28301 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:13.578876 28301 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:13.578943 28301 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:13.579494 28301 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c8000bcdd0f4f5792c591876996cb9a" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 39245 } }
I20260809 03:27:13.579581 28301 leader_election.cc:302] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c8000bcdd0f4f5792c591876996cb9a; no voters:
I20260809 03:27:13.579783 28301 leader_election.cc:288] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:13.579821 28306 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:13.579926 28306 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a [term 1 LEADER]: Becoming Leader. State: Replica: 5c8000bcdd0f4f5792c591876996cb9a, State: Running, Role: LEADER
I20260809 03:27:13.580008 28306 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c8000bcdd0f4f5792c591876996cb9a" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 39245 } }
I20260809 03:27:13.580045 28301 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:13.580338 28306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c8000bcdd0f4f5792c591876996cb9a. Latest consensus state: current_term: 1 leader_uuid: "5c8000bcdd0f4f5792c591876996cb9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c8000bcdd0f4f5792c591876996cb9a" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 39245 } } }
I20260809 03:27:13.580464 28306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:13.580354 28307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c8000bcdd0f4f5792c591876996cb9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c8000bcdd0f4f5792c591876996cb9a" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 39245 } } }
I20260809 03:27:13.580628 28307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:13.580680 28310 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:13.581204 28310 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:13.583299 28310 catalog_manager.cc:1347] Generated new cluster ID: 814d28e701954a9f9c4e2ec2cf09ff5b
I20260809 03:27:13.583356 28310 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:13.587538 28305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.578023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48014 (local address 127.8.5.254:39245)
0809 03:27:13.578221 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:13.578228 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:13.578252 (+ 24us) server_negotiation.cc:407] Connection header received
0809 03:27:13.578389 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:13.578393 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:13.578443 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:13.578548 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:13.578818 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.580388 (+ 1570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.581565 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.582154 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.582266 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.583018 (+ 752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:13.583021 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:13.583022 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:13.583231 (+ 209us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:13.587042 (+ 3811us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:13.587062 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:13.587131 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:13.587257 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 03:27:13.587339 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":94,"threads_started":1}
I20260809 03:27:13.589905 28310 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:13.590384 28310 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:13.601326 28310 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a: Generated new TSK 0
I20260809 03:27:13.601467 28310 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:13.605719 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:39245
--builtin_ntp_servers=127.8.5.212:37443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 03:27:13.696444 28326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:13.696707 28326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:13.696749 28326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:13.697924 28326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:13.697979 28326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:13.698004 28326 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:27:13.699442 28326 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:37443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:39245
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:13.699707 28326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:13.700045 28326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:13.705093 28334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:13.705150 28331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:13.705121 28332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:13.705601 28326 server_base.cc:1034] running on GCE node
I20260809 03:27:13.705804 28326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:13.706054 28326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:13.707217 28326 hybrid_clock.cc:648] HybridClock initialized: now 1786246033707200 us; error 34 us; skew 500 ppm
I20260809 03:27:13.708498 28326 webserver.cc:460] Webserver started at http://127.8.5.193:42691/ using document root <none> and password file <none>
I20260809 03:27:13.708738 28326 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:13.708806 28326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:13.708943 28326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:13.709993 28326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "7c60adfebc2d45d593fbaae3ab53a475"
format_stamp: "Formatted at 2026-08-09 03:27:13 on dist-test-slave-2w3w"
server_key: "d26362f69f351fd68f915c4e65b35186"
server_key_iv: "fb7011d7f8fffe691e985bb5704ab714"
server_key_version: "encryptionkey@0"
I20260809 03:27:13.710363 28326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "7c60adfebc2d45d593fbaae3ab53a475"
format_stamp: "Formatted at 2026-08-09 03:27:13 on dist-test-slave-2w3w"
server_key: "d26362f69f351fd68f915c4e65b35186"
server_key_iv: "fb7011d7f8fffe691e985bb5704ab714"
server_key_version: "encryptionkey@0"
I20260809 03:27:13.711766 28326 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:27:13.712509 28340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:13.712661 28326 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:27:13.712764 28326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "7c60adfebc2d45d593fbaae3ab53a475"
format_stamp: "Formatted at 2026-08-09 03:27:13 on dist-test-slave-2w3w"
server_key: "d26362f69f351fd68f915c4e65b35186"
server_key_iv: "fb7011d7f8fffe691e985bb5704ab714"
server_key_version: "encryptionkey@0"
I20260809 03:27:13.712837 28326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:13.736559 28326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:13.736876 28326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:13.737025 28326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:13.737248 28326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:27:13.737620 28326 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:27:13.737655 28326 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:13.737677 28326 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:27:13.737689 28326 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:13.743745 28326 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:46285
I20260809 03:27:13.743805 28465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:46285 every 8 connection(s)
I20260809 03:27:13.744124 28326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:27:13.749120 28305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.744821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:57179 (local address 127.8.5.254:39245)
0809 03:27:13.744916 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:13.744918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:13.745181 (+ 263us) server_negotiation.cc:407] Connection header received
0809 03:27:13.745669 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:13.745670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:13.745683 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:13.745739 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:13.746400 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.746903 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.747899 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.748086 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.748138 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.748884 (+ 746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:13.748885 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:13.748885 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:13.748889 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:13.748901 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:13.748905 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:13.748948 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:13.749030 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 03:27:13.749062 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 03:27:13.749284 28468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.744815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:39245 (local address 127.8.5.193:57179)
0809 03:27:13.745052 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:13.745087 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:13.745575 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:13.745789 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:13.745792 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:13.745806 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:13.746288 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:13.746292 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.747032 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.747033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:13.747820 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:13.747822 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.748160 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.748161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:13.748267 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.748745 (+ 478us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:27:13.748745 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:13.748772 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:27:13.748795 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:13.748959 (+ 164us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:13.748964 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:13.748966 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:27:13.749017 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 03:27:13.749094 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":135,"threads_started":1}
I20260809 03:27:13.749863 28466 heartbeater.cc:347] Connected to a master server at 127.8.5.254:39245
I20260809 03:27:13.749970 28466 heartbeater.cc:464] Registering TS with master...
I20260809 03:27:13.750147 28466 heartbeater.cc:511] Master 127.8.5.254:39245 requested a full tablet report, sending...
I20260809 03:27:13.750641 28263 ts_manager.cc:194] Registered new tserver with Master: 7c60adfebc2d45d593fbaae3ab53a475 (127.8.5.193:46285)
I20260809 03:27:13.751283 28263 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.5.193:57179
I20260809 03:27:13.752071 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 28326
I20260809 03:27:13.752197 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:27:13.752393 8215 external_mini_cluster.cc:1428] Setting key f84948dcb51f35fca5bb76644f997bac
I20260809 03:27:13.753284 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:39245
--builtin_ntp_servers=127.8.5.212:37443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 03:27:13.836874 28469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:13.837101 28469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:13.837124 28469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:13.838375 28469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:13.838416 28469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:13.838443 28469 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:27:13.839954 28469 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:37443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:39245
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28469
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:13.840145 28469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:13.840389 28469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:13.845155 28474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:13.845144 28475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:13.845144 28477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:13.845424 28469 server_base.cc:1034] running on GCE node
I20260809 03:27:13.845660 28469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:13.845903 28469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:13.847023 28469 hybrid_clock.cc:648] HybridClock initialized: now 1786246033847009 us; error 29 us; skew 500 ppm
I20260809 03:27:13.848366 28469 webserver.cc:460] Webserver started at http://127.8.5.194:40891/ using document root <none> and password file <none>
I20260809 03:27:13.848620 28469 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:13.848690 28469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:13.848855 28469 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:13.849871 28469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "c831b7cace3542aaa51c3d616e2dd0cc"
format_stamp: "Formatted at 2026-08-09 03:27:13 on dist-test-slave-2w3w"
server_key: "921d82bc25efd29bf00b88b779c99423"
server_key_iv: "9eaeef1bd1e2be46c6be628a5ee4e190"
server_key_version: "encryptionkey@0"
I20260809 03:27:13.850220 28469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "c831b7cace3542aaa51c3d616e2dd0cc"
format_stamp: "Formatted at 2026-08-09 03:27:13 on dist-test-slave-2w3w"
server_key: "921d82bc25efd29bf00b88b779c99423"
server_key_iv: "9eaeef1bd1e2be46c6be628a5ee4e190"
server_key_version: "encryptionkey@0"
I20260809 03:27:13.851608 28469 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:27:13.852365 28483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:13.852561 28469 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:13.852659 28469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "c831b7cace3542aaa51c3d616e2dd0cc"
format_stamp: "Formatted at 2026-08-09 03:27:13 on dist-test-slave-2w3w"
server_key: "921d82bc25efd29bf00b88b779c99423"
server_key_iv: "9eaeef1bd1e2be46c6be628a5ee4e190"
server_key_version: "encryptionkey@0"
I20260809 03:27:13.852734 28469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:13.878921 28469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:13.879280 28469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:13.879437 28469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:13.879724 28469 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:27:13.880084 28469 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:27:13.880136 28469 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:13.880179 28469 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:27:13.880206 28469 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:13.885929 28469 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:39585
I20260809 03:27:13.885978 28606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:39585 every 8 connection(s)
I20260809 03:27:13.886297 28469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:27:13.888777 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 28469
I20260809 03:27:13.888907 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:27:13.889086 8215 external_mini_cluster.cc:1428] Setting key b837a8960fc5f8b1da21a29d53e3be09
I20260809 03:27:13.889988 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:39245
--builtin_ntp_servers=127.8.5.212:37443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 03:27:13.891808 28305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.887005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:43265 (local address 127.8.5.254:39245)
0809 03:27:13.887068 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:13.887070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:13.887292 (+ 222us) server_negotiation.cc:407] Connection header received
0809 03:27:13.887825 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:13.887827 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:13.887840 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:13.887888 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:13.888538 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.889191 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.890224 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.890534 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.890612 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.891466 (+ 854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:13.891468 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:13.891468 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:13.891473 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:13.891490 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:13.891494 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:13.891558 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:13.891667 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 03:27:13.891699 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 03:27:13.892069 28609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:13.886999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:39245 (local address 127.8.5.194:43265)
0809 03:27:13.887171 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:13.887204 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:13.887698 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:13.887960 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:13.887963 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:13.887971 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:13.888445 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:13.888449 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.889289 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.889289 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:13.890107 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:13.890110 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:13.890623 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:13.890623 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:13.890732 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:13.891336 (+ 604us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:27:13.891337 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:13.891364 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:27:13.891384 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:13.891557 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:13.891560 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:13.891581 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 03:27:13.891654 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 03:27:13.891768 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":80,"threads_started":1}
I20260809 03:27:13.892562 28607 heartbeater.cc:347] Connected to a master server at 127.8.5.254:39245
I20260809 03:27:13.892643 28607 heartbeater.cc:464] Registering TS with master...
I20260809 03:27:13.892839 28607 heartbeater.cc:511] Master 127.8.5.254:39245 requested a full tablet report, sending...
I20260809 03:27:13.893193 28263 ts_manager.cc:194] Registered new tserver with Master: c831b7cace3542aaa51c3d616e2dd0cc (127.8.5.194:39585)
I20260809 03:27:13.893560 28263 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.5.194:43265
W20260809 03:27:13.974184 28610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:13.974375 28610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:13.974396 28610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:13.975663 28610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:13.975704 28610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:13.975729 28610 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:27:13.977062 28610 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:37443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:39245
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:13.977303 28610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:13.977600 28610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:13.982761 28615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:13.982785 28618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:13.982733 28616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:13.982951 28610 server_base.cc:1034] running on GCE node
I20260809 03:27:13.983192 28610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:13.983443 28610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:13.984606 28610 hybrid_clock.cc:648] HybridClock initialized: now 1786246033984585 us; error 43 us; skew 500 ppm
I20260809 03:27:13.986011 28610 webserver.cc:460] Webserver started at http://127.8.5.195:41359/ using document root <none> and password file <none>
I20260809 03:27:13.986250 28610 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:13.986318 28610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:13.986461 28610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:13.987483 28610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "ac9e2e276a4548d5925467b51002b08c"
format_stamp: "Formatted at 2026-08-09 03:27:13 on dist-test-slave-2w3w"
server_key: "c0b57003aa13cf4e35c074dfb5276b9a"
server_key_iv: "70cad6790dbe80657d8a5150f972cd7f"
server_key_version: "encryptionkey@0"
I20260809 03:27:13.987834 28610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "ac9e2e276a4548d5925467b51002b08c"
format_stamp: "Formatted at 2026-08-09 03:27:13 on dist-test-slave-2w3w"
server_key: "c0b57003aa13cf4e35c074dfb5276b9a"
server_key_iv: "70cad6790dbe80657d8a5150f972cd7f"
server_key_version: "encryptionkey@0"
I20260809 03:27:13.989148 28610 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:27:13.989847 28624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:13.990018 28610 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:27:13.990123 28610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "ac9e2e276a4548d5925467b51002b08c"
format_stamp: "Formatted at 2026-08-09 03:27:13 on dist-test-slave-2w3w"
server_key: "c0b57003aa13cf4e35c074dfb5276b9a"
server_key_iv: "70cad6790dbe80657d8a5150f972cd7f"
server_key_version: "encryptionkey@0"
I20260809 03:27:13.990195 28610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:14.000583 28610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:14.000860 28610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:14.001005 28610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:14.001215 28610 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:27:14.001549 28610 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:27:14.001602 28610 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:14.001641 28610 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:27:14.001667 28610 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:14.007313 28610 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:35881
I20260809 03:27:14.007362 28747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:35881 every 8 connection(s)
I20260809 03:27:14.007671 28610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:27:14.013006 28305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:14.008363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:49465 (local address 127.8.5.254:39245)
0809 03:27:14.008431 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:14.008432 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:14.008613 (+ 181us) server_negotiation.cc:407] Connection header received
0809 03:27:14.009097 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:14.009098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:14.009109 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:14.009164 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:14.009818 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.010310 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.011346 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.011591 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.011668 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:14.012736 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:14.012737 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:14.012738 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:14.012743 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:14.012761 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:14.012766 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:14.012839 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:14.012924 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 03:27:14.012948 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 03:27:14.013206 28750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:14.008352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:39245 (local address 127.8.5.195:49465)
0809 03:27:14.008518 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:14.008548 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:14.009008 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:14.009236 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:14.009239 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:14.009247 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:14.009731 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:14.009735 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.010384 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.010384 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:14.011250 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:14.011252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.011679 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.011681 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:14.011865 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:14.012575 (+ 710us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:27:14.012576 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:14.012612 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:27:14.012637 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:14.012851 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:14.012857 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:14.012860 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:27:14.012920 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 03:27:14.013005 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":87,"threads_started":1}
I20260809 03:27:14.013696 28748 heartbeater.cc:347] Connected to a master server at 127.8.5.254:39245
I20260809 03:27:14.013799 28748 heartbeater.cc:464] Registering TS with master...
I20260809 03:27:14.013978 28748 heartbeater.cc:511] Master 127.8.5.254:39245 requested a full tablet report, sending...
I20260809 03:27:14.014344 28263 ts_manager.cc:194] Registered new tserver with Master: ac9e2e276a4548d5925467b51002b08c (127.8.5.195:35881)
I20260809 03:27:14.014719 28263 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.5.195:49465
I20260809 03:27:14.016012 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 28610
I20260809 03:27:14.016111 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:27:14.016316 8215 external_mini_cluster.cc:1428] Setting key ea9f5a298039e5641fea5ef59f0d41b0
I20260809 03:27:14.017174 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:27:14.021155 28305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:14.018522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48030 (local address 127.8.5.254:39245)
0809 03:27:14.018556 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:14.018558 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:14.018678 (+ 120us) server_negotiation.cc:407] Connection header received
0809 03:27:14.018713 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:14.018714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:14.018721 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:14.018763 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:14.018910 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.019427 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.020137 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.020309 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.020359 (+ 50us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:14.020933 (+ 574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:14.020934 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:14.020934 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:14.020938 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:14.020949 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:14.020953 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:14.021022 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:14.021092 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 03:27:14.021103 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260809 03:27:14.022580 28263 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48030:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:27:14.024276 28263 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:27:14.030556 28759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:14.026400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47382 (local address 127.8.5.194:39585)
0809 03:27:14.026940 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:14.026943 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:14.026950 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:27:14.027025 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:14.027027 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:14.027041 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:14.027124 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:14.027397 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.028441 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.029655 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.030142 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.030240 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:14.030332 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:14.030436 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 03:27:14.030475 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":84,"threads_started":1}
I20260809 03:27:14.030547 28756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:14.026303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:39585 (local address 127.0.0.1:47382)
0809 03:27:14.026460 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:14.026497 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:14.026558 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:14.027252 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:14.027253 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:14.027255 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:14.027301 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:14.027302 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.028528 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.028528 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:14.029581 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:14.029583 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.030245 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.030246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:14.030327 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:14.030348 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 03:27:14.030421 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 03:27:14.030472 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":65,"threads_started":1}
I20260809 03:27:14.030715 28761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:14.026533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38544 (local address 127.8.5.193:46285)
0809 03:27:14.026710 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:14.026714 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:14.026722 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:27:14.026753 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:14.026754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:14.026765 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:14.026841 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:14.027016 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.028128 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.029543 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.030234 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.030291 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:14.030367 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:14.030598 (+ 231us) server_negotiation.cc:299] Negotiation successful
0809 03:27:14.030636 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":73,"threads_started":1}
I20260809 03:27:14.030725 28760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:14.026509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33884 (local address 127.8.5.195:35881)
0809 03:27:14.027063 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:14.027067 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:14.027075 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:27:14.027111 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:14.027113 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:14.027125 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:14.027190 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:14.027393 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.028068 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.029451 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.030167 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.030239 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:14.030339 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:14.030598 (+ 259us) server_negotiation.cc:299] Negotiation successful
0809 03:27:14.030635 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":74,"threads_started":1}
I20260809 03:27:14.031114 28757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:14.026313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:35881 (local address 127.0.0.1:33884)
0809 03:27:14.026701 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:14.026707 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:14.026731 (+ 24us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:14.027269 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:14.027270 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:14.027272 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:14.027314 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:14.027316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.028154 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.028155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:14.029366 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:14.029368 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.030378 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.030379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:14.030444 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:14.030447 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:27:14.030498 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 03:27:14.030553 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"mutex_wait_us":80,"thread_start_us":84,"threads_started":1}
I20260809 03:27:14.031136 28758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:14.026306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:46285 (local address 127.0.0.1:38544)
0809 03:27:14.026582 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:14.026592 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:14.026632 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:14.026851 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:14.026854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:14.026856 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:14.026901 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:14.026902 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.028223 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.028223 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:14.029459 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:14.029461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.030396 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.030397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:14.030446 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:14.030449 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:27:14.030498 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 03:27:14.030554 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":37,"thread_start_us":92,"threads_started":1}
I20260809 03:27:14.031780 28395 tablet_service.cc:1467] Processing CreateTablet for tablet 10e6dc71053e44f181968c730653c84c (DEFAULT_TABLE table=test-table [id=11b5358f6d134f75a55ef48697978490]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:27:14.031823 28536 tablet_service.cc:1467] Processing CreateTablet for tablet 10e6dc71053e44f181968c730653c84c (DEFAULT_TABLE table=test-table [id=11b5358f6d134f75a55ef48697978490]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:27:14.031831 28675 tablet_service.cc:1467] Processing CreateTablet for tablet 10e6dc71053e44f181968c730653c84c (DEFAULT_TABLE table=test-table [id=11b5358f6d134f75a55ef48697978490]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:27:14.032140 28395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10e6dc71053e44f181968c730653c84c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:14.032141 28536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10e6dc71053e44f181968c730653c84c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:14.032141 28675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10e6dc71053e44f181968c730653c84c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:14.034597 28762 tablet_bootstrap.cc:492] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475: Bootstrap starting.
I20260809 03:27:14.035425 28762 tablet_bootstrap.cc:654] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:14.035547 28765 tablet_bootstrap.cc:492] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c: Bootstrap starting.
I20260809 03:27:14.035595 28763 tablet_bootstrap.cc:492] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc: Bootstrap starting.
I20260809 03:27:14.035789 28762 log.cc:824] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:14.036203 28763 tablet_bootstrap.cc:654] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:14.036203 28765 tablet_bootstrap.cc:654] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:14.036536 28763 log.cc:824] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:14.036536 28765 log.cc:824] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:14.036707 28762 tablet_bootstrap.cc:492] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475: No bootstrap required, opened a new log
I20260809 03:27:14.036783 28762 ts_tablet_manager.cc:1397] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 03:27:14.037287 28763 tablet_bootstrap.cc:492] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc: No bootstrap required, opened a new log
I20260809 03:27:14.037374 28763 ts_tablet_manager.cc:1397] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:27:14.037621 28765 tablet_bootstrap.cc:492] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c: No bootstrap required, opened a new log
I20260809 03:27:14.037716 28765 ts_tablet_manager.cc:1397] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:27:14.038950 28762 raft_consensus.cc:348] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c60adfebc2d45d593fbaae3ab53a475" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46285 } } peers { permanent_uuid: "c831b7cace3542aaa51c3d616e2dd0cc" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39585 } } peers { permanent_uuid: "ac9e2e276a4548d5925467b51002b08c" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35881 } }
I20260809 03:27:14.039171 28762 raft_consensus.cc:374] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:14.039216 28762 raft_consensus.cc:729] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c60adfebc2d45d593fbaae3ab53a475, State: Initialized, Role: FOLLOWER
I20260809 03:27:14.039330 28762 consensus_queue.cc:260] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c60adfebc2d45d593fbaae3ab53a475" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46285 } } peers { permanent_uuid: "c831b7cace3542aaa51c3d616e2dd0cc" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39585 } } peers { permanent_uuid: "ac9e2e276a4548d5925467b51002b08c" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35881 } }
I20260809 03:27:14.039610 28762 ts_tablet_manager.cc:1428] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260809 03:27:14.039755 28466 heartbeater.cc:503] Master 127.8.5.254:39245 was elected leader, sending a full tablet report...
I20260809 03:27:14.039995 28763 raft_consensus.cc:348] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c60adfebc2d45d593fbaae3ab53a475" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46285 } } peers { permanent_uuid: "c831b7cace3542aaa51c3d616e2dd0cc" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39585 } } peers { permanent_uuid: "ac9e2e276a4548d5925467b51002b08c" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35881 } }
I20260809 03:27:14.040156 28763 raft_consensus.cc:374] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:14.040197 28763 raft_consensus.cc:729] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c831b7cace3542aaa51c3d616e2dd0cc, State: Initialized, Role: FOLLOWER
I20260809 03:27:14.040330 28763 consensus_queue.cc:260] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c60adfebc2d45d593fbaae3ab53a475" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46285 } } peers { permanent_uuid: "c831b7cace3542aaa51c3d616e2dd0cc" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39585 } } peers { permanent_uuid: "ac9e2e276a4548d5925467b51002b08c" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35881 } }
I20260809 03:27:14.040324 28765 raft_consensus.cc:348] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c60adfebc2d45d593fbaae3ab53a475" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46285 } } peers { permanent_uuid: "c831b7cace3542aaa51c3d616e2dd0cc" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39585 } } peers { permanent_uuid: "ac9e2e276a4548d5925467b51002b08c" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35881 } }
I20260809 03:27:14.040464 28765 raft_consensus.cc:374] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:14.040511 28765 raft_consensus.cc:729] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac9e2e276a4548d5925467b51002b08c, State: Initialized, Role: FOLLOWER
I20260809 03:27:14.040577 28763 ts_tablet_manager.cc:1428] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 03:27:14.040619 28765 consensus_queue.cc:260] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c60adfebc2d45d593fbaae3ab53a475" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46285 } } peers { permanent_uuid: "c831b7cace3542aaa51c3d616e2dd0cc" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39585 } } peers { permanent_uuid: "ac9e2e276a4548d5925467b51002b08c" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35881 } }
I20260809 03:27:14.040683 28607 heartbeater.cc:503] Master 127.8.5.254:39245 was elected leader, sending a full tablet report...
I20260809 03:27:14.040884 28765 ts_tablet_manager.cc:1428] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 03:27:14.040916 28748 heartbeater.cc:503] Master 127.8.5.254:39245 was elected leader, sending a full tablet report...
I20260809 03:27:14.070138 28769 raft_consensus.cc:482] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:27:14.070276 28769 raft_consensus.cc:504] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c60adfebc2d45d593fbaae3ab53a475" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46285 } } peers { permanent_uuid: "c831b7cace3542aaa51c3d616e2dd0cc" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39585 } } peers { permanent_uuid: "ac9e2e276a4548d5925467b51002b08c" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35881 } }
I20260809 03:27:14.070667 28769 leader_election.cc:288] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c831b7cace3542aaa51c3d616e2dd0cc (127.8.5.194:39585), ac9e2e276a4548d5925467b51002b08c (127.8.5.195:35881)
I20260809 03:27:14.073519 28759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:14.070941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:58463 (local address 127.8.5.194:39585)
0809 03:27:14.071000 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:14.071002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:14.071009 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:27:14.071041 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:14.071042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:14.071051 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:14.071125 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:14.071275 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.071754 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.072764 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.073156 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.073244 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:14.073254 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:14.073412 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 03:27:14.073450 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:27:14.073558 28468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:14.070828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:39585 (local address 127.8.5.193:58463)
0809 03:27:14.070905 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:14.070917 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:14.070983 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:14.071129 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:14.071130 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:14.071132 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:14.071206 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:14.071208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.071847 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.071848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:14.072577 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:14.072578 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.073247 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.073248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:14.073334 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:14.073337 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:27:14.073407 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 03:27:14.073448 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 03:27:14.073570 28760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:14.070934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:46173 (local address 127.8.5.195:35881)
0809 03:27:14.071001 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:14.071003 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:14.071157 (+ 154us) server_negotiation.cc:407] Connection header received
0809 03:27:14.071232 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:14.071233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:14.071241 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:14.071306 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:14.071482 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.071934 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.072848 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.073200 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.073286 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:14.073297 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:14.073462 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 03:27:14.073501 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 03:27:14.073781 28772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:14.070898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:35881 (local address 127.8.5.193:46173)
0809 03:27:14.071070 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:14.071080 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:14.071165 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:14.071311 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:14.071312 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:14.071313 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:14.071386 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:14.071390 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.072021 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.072022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:14.072754 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:14.072756 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.073314 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.073315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:14.073387 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:14.073390 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:27:14.073455 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 03:27:14.073493 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":119,"threads_started":1}
I20260809 03:27:14.073896 28557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10e6dc71053e44f181968c730653c84c" candidate_uuid: "7c60adfebc2d45d593fbaae3ab53a475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c831b7cace3542aaa51c3d616e2dd0cc" is_pre_election: true
I20260809 03:27:14.074055 28557 raft_consensus.cc:2454] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c60adfebc2d45d593fbaae3ab53a475 in term 0.
I20260809 03:27:14.074112 28696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10e6dc71053e44f181968c730653c84c" candidate_uuid: "7c60adfebc2d45d593fbaae3ab53a475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac9e2e276a4548d5925467b51002b08c" is_pre_election: true
I20260809 03:27:14.074259 28696 raft_consensus.cc:2454] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c60adfebc2d45d593fbaae3ab53a475 in term 0.
I20260809 03:27:14.074301 28345 leader_election.cc:302] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c60adfebc2d45d593fbaae3ab53a475, c831b7cace3542aaa51c3d616e2dd0cc; no voters:
I20260809 03:27:14.074440 28769 raft_consensus.cc:2781] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:27:14.074491 28769 raft_consensus.cc:482] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:27:14.074517 28769 raft_consensus.cc:3037] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:14.075376 28769 raft_consensus.cc:504] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c60adfebc2d45d593fbaae3ab53a475" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46285 } } peers { permanent_uuid: "c831b7cace3542aaa51c3d616e2dd0cc" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39585 } } peers { permanent_uuid: "ac9e2e276a4548d5925467b51002b08c" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35881 } }
I20260809 03:27:14.075546 28769 leader_election.cc:288] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [CANDIDATE]: Term 1 election: Requested vote from peers c831b7cace3542aaa51c3d616e2dd0cc (127.8.5.194:39585), ac9e2e276a4548d5925467b51002b08c (127.8.5.195:35881)
I20260809 03:27:14.075712 28557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10e6dc71053e44f181968c730653c84c" candidate_uuid: "7c60adfebc2d45d593fbaae3ab53a475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c831b7cace3542aaa51c3d616e2dd0cc"
I20260809 03:27:14.075699 28696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10e6dc71053e44f181968c730653c84c" candidate_uuid: "7c60adfebc2d45d593fbaae3ab53a475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac9e2e276a4548d5925467b51002b08c"
I20260809 03:27:14.075781 28557 raft_consensus.cc:3037] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:14.075790 28696 raft_consensus.cc:3037] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:14.076647 28696 raft_consensus.cc:2454] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c60adfebc2d45d593fbaae3ab53a475 in term 1.
I20260809 03:27:14.076647 28557 raft_consensus.cc:2454] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c60adfebc2d45d593fbaae3ab53a475 in term 1.
I20260809 03:27:14.076942 28344 leader_election.cc:302] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c60adfebc2d45d593fbaae3ab53a475, ac9e2e276a4548d5925467b51002b08c; no voters:
I20260809 03:27:14.077064 28769 raft_consensus.cc:2781] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:14.077231 28769 raft_consensus.cc:686] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [term 1 LEADER]: Becoming Leader. State: Replica: 7c60adfebc2d45d593fbaae3ab53a475, State: Running, Role: LEADER
I20260809 03:27:14.077354 28769 consensus_queue.cc:237] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c60adfebc2d45d593fbaae3ab53a475" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46285 } } peers { permanent_uuid: "c831b7cace3542aaa51c3d616e2dd0cc" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39585 } } peers { permanent_uuid: "ac9e2e276a4548d5925467b51002b08c" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35881 } }
I20260809 03:27:14.078204 28263 catalog_manager.cc:5495] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c60adfebc2d45d593fbaae3ab53a475 (127.8.5.193). New cstate: current_term: 1 leader_uuid: "7c60adfebc2d45d593fbaae3ab53a475" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c60adfebc2d45d593fbaae3ab53a475" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 46285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c831b7cace3542aaa51c3d616e2dd0cc" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac9e2e276a4548d5925467b51002b08c" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35881 } health_report { overall_health: UNKNOWN } } }
I20260809 03:27:14.091718 28761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:14.089527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38546 (local address 127.8.5.193:46285)
0809 03:27:14.089585 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:14.089586 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:14.089613 (+ 27us) server_negotiation.cc:407] Connection header received
0809 03:27:14.089641 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:14.089642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:14.089659 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:14.089710 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:27:14.089864 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.090304 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.091066 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:14.091245 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:14.091297 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:14.091442 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:27:14.091524 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:27:14.091593 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:14.091638 (+ 45us) server_negotiation.cc:299] Negotiation successful
0809 03:27:14.091647 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 03:27:14.093544 28557 raft_consensus.cc:1261] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc [term 1 FOLLOWER]: Refusing update from remote peer 7c60adfebc2d45d593fbaae3ab53a475: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:27:14.093544 28696 raft_consensus.cc:1261] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c [term 1 FOLLOWER]: Refusing update from remote peer 7c60adfebc2d45d593fbaae3ab53a475: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:27:14.093969 28773 consensus_queue.cc:1035] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c831b7cace3542aaa51c3d616e2dd0cc" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:27:14.094111 28769 consensus_queue.cc:1035] T 10e6dc71053e44f181968c730653c84c P 7c60adfebc2d45d593fbaae3ab53a475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac9e2e276a4548d5925467b51002b08c" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:27:14.097857 28777 mvcc.cc:205] Tried to move back new op lower bound from 7316463755644473344 to 7316463755581538304. Current Snapshot: MvccSnapshot[applied={T|T < 7316463755644473344}]
I20260809 03:27:14.100169 28263 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:27:14.100276 28263 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:27:14.101006 28263 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5c8000bcdd0f4f5792c591876996cb9a: Sending DeleteTablet for 3 replicas of tablet 10e6dc71053e44f181968c730653c84c
I20260809 03:27:14.101317 28536 tablet_service.cc:1514] Processing DeleteTablet for tablet 10e6dc71053e44f181968c730653c84c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:27:14 UTC) from {username='slave'} at 127.0.0.1:47382
I20260809 03:27:14.101397 28675 tablet_service.cc:1514] Processing DeleteTablet for tablet 10e6dc71053e44f181968c730653c84c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:27:14 UTC) from {username='slave'} at 127.0.0.1:33884
I20260809 03:27:14.101576 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 28326
I20260809 03:27:14.101629 28395 tablet_service.cc:1514] Processing DeleteTablet for tablet 10e6dc71053e44f181968c730653c84c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:27:14 UTC) from {username='slave'} at 127.0.0.1:38544
I20260809 03:27:14.102600 28787 tablet_replica.cc:330] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c: stopping tablet replica
I20260809 03:27:14.102692 28787 raft_consensus.cc:2229] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:27:14.102787 28787 raft_consensus.cc:2258] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:27:14.103253 28787 ts_tablet_manager.cc:1905] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:27:14.104082 28786 tablet_replica.cc:330] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc: stopping tablet replica
I20260809 03:27:14.104194 28786 raft_consensus.cc:2229] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:27:14.104300 28786 raft_consensus.cc:2258] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:27:14.104841 28786 ts_tablet_manager.cc:1905] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:27:14.105562 28787 ts_tablet_manager.cc:1918] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:27:14.105659 28787 log.cc:1196] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/10e6dc71053e44f181968c730653c84c
I20260809 03:27:14.106048 28787 ts_tablet_manager.cc:1939] T 10e6dc71053e44f181968c730653c84c P ac9e2e276a4548d5925467b51002b08c: Deleting consensus metadata
I20260809 03:27:14.106424 28786 ts_tablet_manager.cc:1918] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:27:14.106520 28786 log.cc:1196] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/10e6dc71053e44f181968c730653c84c
I20260809 03:27:14.106580 28249 catalog_manager.cc:4841] TS ac9e2e276a4548d5925467b51002b08c (127.8.5.195:35881): tablet 10e6dc71053e44f181968c730653c84c (table test-table [id=11b5358f6d134f75a55ef48697978490]) successfully deleted
I20260809 03:27:14.106805 28786 ts_tablet_manager.cc:1939] T 10e6dc71053e44f181968c730653c84c P c831b7cace3542aaa51c3d616e2dd0cc: Deleting consensus metadata
I20260809 03:27:14.107424 28250 catalog_manager.cc:4841] TS c831b7cace3542aaa51c3d616e2dd0cc (127.8.5.194:39585): tablet 10e6dc71053e44f181968c730653c84c (table test-table [id=11b5358f6d134f75a55ef48697978490]) successfully deleted
W20260809 03:27:14.111937 28247 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.5.193:46285 (error 108)
I20260809 03:27:14.112411 28757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:14.112278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:46285 (local address 127.0.0.1:38556)
0809 03:27:14.112332 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:14.112371 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.193:46285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260809 03:27:14.112447 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 28469
W20260809 03:27:14.112564 28247 catalog_manager.cc:4584] TS 7c60adfebc2d45d593fbaae3ab53a475 (127.8.5.193:46285): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 10e6dc71053e44f181968c730653c84c: Network error: Client connection negotiation failed: client connection to 127.8.5.193:46285: connect: Connection refused (error 111)
I20260809 03:27:14.118149 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 28610
I20260809 03:27:14.124033 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 28230
2026-08-09T03:27:14Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (700 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:14 dist-test-slave-2w3w krb5kdc[28791](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:14 dist-test-slave-2w3w krb5kdc[28791](info): set up 2 sockets
Aug 09 03:27:14 dist-test-slave-2w3w krb5kdc[28791](info): commencing operation
krb5kdc: starting...
W20260809 03:27:15.189025 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:15 dist-test-slave-2w3w krb5kdc[28791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:27:15.309739 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:45165
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:45165
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:15.392309 28804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:15.392531 28804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:15.392571 28804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:15.393711 28804 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:15.393776 28804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:15.393801 28804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:15.393827 28804 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:15.393864 28804 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:15.395401 28804 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:45165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:45165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28804
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:15.395670 28804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:15.395905 28804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:15.400811 28813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:15.400787 28810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:15.400861 28811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:15.401117 28804 server_base.cc:1034] running on GCE node
I20260809 03:27:15.401381 28804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:15.401715 28804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:15.402894 28804 hybrid_clock.cc:648] HybridClock initialized: now 1786246035402879 us; error 28 us; skew 500 ppm
Aug 09 03:27:15 dist-test-slave-2w3w krb5kdc[28791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246035, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:15.405442 28804 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:27:15.405834 28804 webserver.cc:460] Webserver started at http://127.8.5.254:46515/ using document root <none> and password file <none>
I20260809 03:27:15.406015 28804 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:15.406055 28804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:15.406142 28804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:15.407223 28804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "2a4adfd072eb40bd97c38b1b06698074"
format_stamp: "Formatted at 2026-08-09 03:27:15 on dist-test-slave-2w3w"
server_key: "b9dcf42708952a588a1d9dc2af74ee08"
server_key_iv: "7dbad28b5957ec25fcbbc37e0c8585b5"
server_key_version: "encryptionkey@0"
I20260809 03:27:15.407533 28804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "2a4adfd072eb40bd97c38b1b06698074"
format_stamp: "Formatted at 2026-08-09 03:27:15 on dist-test-slave-2w3w"
server_key: "b9dcf42708952a588a1d9dc2af74ee08"
server_key_iv: "7dbad28b5957ec25fcbbc37e0c8585b5"
server_key_version: "encryptionkey@0"
I20260809 03:27:15.408814 28804 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:27:15.409578 28821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:15.409775 28804 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:15.409868 28804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "2a4adfd072eb40bd97c38b1b06698074"
format_stamp: "Formatted at 2026-08-09 03:27:15 on dist-test-slave-2w3w"
server_key: "b9dcf42708952a588a1d9dc2af74ee08"
server_key_iv: "7dbad28b5957ec25fcbbc37e0c8585b5"
server_key_version: "encryptionkey@0"
I20260809 03:27:15.409926 28804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:15.416833 28804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:15.418619 28804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:15.418730 28804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:15.422788 28804 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:45165
I20260809 03:27:15.422842 28875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:45165 every 8 connection(s)
I20260809 03:27:15.423209 28804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:15.424106 28876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:15.424412 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 28804
I20260809 03:27:15.424531 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:15.424746 8215 external_mini_cluster.cc:1428] Setting key 93f6de0d22bf0072a037b7e8855ec422
I20260809 03:27:15.427316 28876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074: Bootstrap starting.
I20260809 03:27:15.428013 28876 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:15.428323 28876 log.cc:824] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:15.429039 28876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074: No bootstrap required, opened a new log
I20260809 03:27:15.431177 28876 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4adfd072eb40bd97c38b1b06698074" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45165 } }
I20260809 03:27:15.431336 28876 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:15.431406 28876 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4adfd072eb40bd97c38b1b06698074, State: Initialized, Role: FOLLOWER
I20260809 03:27:15.431555 28876 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4adfd072eb40bd97c38b1b06698074" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45165 } }
I20260809 03:27:15.431640 28876 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:15.431685 28876 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:15.431735 28876 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074 [term 0 FOLLOWER]: Advancing to term 1
Aug 09 03:27:15 dist-test-slave-2w3w krb5kdc[28791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:15.432365 28876 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4adfd072eb40bd97c38b1b06698074" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45165 } }
I20260809 03:27:15.432485 28876 leader_election.cc:302] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a4adfd072eb40bd97c38b1b06698074; no voters:
I20260809 03:27:15.432698 28876 leader_election.cc:288] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:15.432742 28881 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:15.432928 28881 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074 [term 1 LEADER]: Becoming Leader. State: Replica: 2a4adfd072eb40bd97c38b1b06698074, State: Running, Role: LEADER
I20260809 03:27:15.432976 28876 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:15.433022 28881 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4adfd072eb40bd97c38b1b06698074" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45165 } }
I20260809 03:27:15.433342 28881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a4adfd072eb40bd97c38b1b06698074. Latest consensus state: current_term: 1 leader_uuid: "2a4adfd072eb40bd97c38b1b06698074" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4adfd072eb40bd97c38b1b06698074" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45165 } } }
I20260809 03:27:15.433411 28883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a4adfd072eb40bd97c38b1b06698074" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4adfd072eb40bd97c38b1b06698074" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45165 } } }
I20260809 03:27:15.433416 28881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:15.433472 28883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:15.433770 28888 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:15.434276 28888 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:15.435609 28899 mvcc.cc:205] Tried to move back new op lower bound from 7316463761142841344 to 7316463761134051328. Current Snapshot: MvccSnapshot[applied={T|T < 7316463761142841344}]
I20260809 03:27:15.436081 28888 catalog_manager.cc:1347] Generated new cluster ID: c7fd227203c147fd94ff49cfad06bf72
I20260809 03:27:15.436134 28888 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:15.436422 28879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:15.425327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49926 (local address 127.8.5.254:45165)
0809 03:27:15.425547 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:15.425556 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:15.425591 (+ 35us) server_negotiation.cc:407] Connection header received
0809 03:27:15.426092 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:15.426101 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:15.426163 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:15.426321 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:15.426896 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:15.428315 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:15.429259 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:15.429682 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:15.429805 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:15.432448 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:15.432452 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:15.432452 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:15.432465 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:15.434702 (+ 2237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:15.435167 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:15.435170 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:15.435170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:15.435273 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:15.435503 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:15.435504 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:15.435505 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:15.435843 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:15.436020 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:15.436123 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 03:27:15.436260 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":90,"threads_started":1}
I20260809 03:27:15.470659 28888 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:15.471482 28888 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:15.475939 28888 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074: Generated new TSK 0
I20260809 03:27:15.476135 28888 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.5.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
Entry for principal kudu/127.8.5.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab.
I20260809 03:27:15.513823 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:45165
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:15.612288 28903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:15.612510 28903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:15.612607 28903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:15.613830 28903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:15.613894 28903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:15.613940 28903 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:27:15.615593 28903 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.193.keytab
--principal=kudu/127.8.5.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:45165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:15.615860 28903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:15.616117 28903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:15.621233 28908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:15.621261 28909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:15.621438 28903 server_base.cc:1034] running on GCE node
W20260809 03:27:15.621234 28911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:15.621770 28903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:15.622032 28903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:15.623201 28903 hybrid_clock.cc:648] HybridClock initialized: now 1786246035623189 us; error 27 us; skew 500 ppm
Aug 09 03:27:15 dist-test-slave-2w3w krb5kdc[28791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246035, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:15.625559 28903 init.cc:377] Logged in from keytab as kudu/127.8.5.193@KRBTEST.COM (short username kudu)
I20260809 03:27:15.626266 28903 webserver.cc:460] Webserver started at http://127.8.5.193:46215/ using document root <none> and password file <none>
I20260809 03:27:15.626505 28903 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:15.626575 28903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:15.626727 28903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:15.627811 28903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "c84bd881133d473e93cecfafb23be1c1"
format_stamp: "Formatted at 2026-08-09 03:27:15 on dist-test-slave-2w3w"
server_key: "8a1e4a01962a3fe2a1db88a40f036219"
server_key_iv: "7815566357e4e2c7e7b14f2391c7509f"
server_key_version: "encryptionkey@0"
I20260809 03:27:15.628196 28903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "c84bd881133d473e93cecfafb23be1c1"
format_stamp: "Formatted at 2026-08-09 03:27:15 on dist-test-slave-2w3w"
server_key: "8a1e4a01962a3fe2a1db88a40f036219"
server_key_iv: "7815566357e4e2c7e7b14f2391c7509f"
server_key_version: "encryptionkey@0"
I20260809 03:27:15.629528 28903 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 03:27:15.630271 28919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:15.630481 28903 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:27:15.630577 28903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "c84bd881133d473e93cecfafb23be1c1"
format_stamp: "Formatted at 2026-08-09 03:27:15 on dist-test-slave-2w3w"
server_key: "8a1e4a01962a3fe2a1db88a40f036219"
server_key_iv: "7815566357e4e2c7e7b14f2391c7509f"
server_key_version: "encryptionkey@0"
I20260809 03:27:15.630666 28903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:15.648366 28903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:15.650153 28903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:15.650313 28903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:15.650542 28903 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:27:15.650897 28903 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:27:15.650950 28903 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:15.651008 28903 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:27:15.651037 28903 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:15.657021 28903 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:43103
I20260809 03:27:15.657074 29041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:43103 every 8 connection(s)
I20260809 03:27:15.657372 28903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:27:15.661001 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 28903
I20260809 03:27:15.661130 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:27:15.661371 8215 external_mini_cluster.cc:1428] Setting key a034602bbc0015c88bf1a28e25294833
Aug 09 03:27:15 dist-test-slave-2w3w krb5kdc[28791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246035, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.193@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:15.667251 28879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:15.658040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:42401 (local address 127.8.5.254:45165)
0809 03:27:15.658081 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:15.658084 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:15.658286 (+ 202us) server_negotiation.cc:407] Connection header received
0809 03:27:15.658756 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:15.658757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:15.658766 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:15.658846 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:15.659774 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:15.660277 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:15.661329 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:15.661663 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:15.661734 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:15.664216 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:15.664218 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:15.664218 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:15.664227 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:15.665775 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:15.666152 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:15.666153 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:15.666154 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:15.666216 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:15.666463 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:15.666464 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:15.666464 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:15.666617 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:15.666695 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:15.667036 (+ 341us) server_negotiation.cc:299] Negotiation successful
0809 03:27:15.667133 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 03:27:15.667348 29044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:15.657990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:45165 (local address 127.8.5.193:42401)
0809 03:27:15.658155 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:15.658197 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:15.658674 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:15.658901 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:15.658904 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:15.659513 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:15.659696 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:15.659701 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:15.660368 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:15.660368 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:15.661212 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:15.661215 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:15.661760 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:15.661761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:15.661912 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:15.662450 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:15.662458 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:15.664119 (+ 1661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:15.665857 (+ 1738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:15.665863 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:15.665864 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:15.666078 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:15.666284 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:15.666285 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:15.666285 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:15.666392 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:15.666689 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:15.666693 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:15.666881 (+ 188us) client_negotiation.cc:769] Sending connection context
0809 03:27:15.667021 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 03:27:15.667160 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":92,"threads_started":1}
I20260809 03:27:15.667907 29042 heartbeater.cc:347] Connected to a master server at 127.8.5.254:45165
I20260809 03:27:15.668015 29042 heartbeater.cc:464] Registering TS with master...
I20260809 03:27:15.668180 29042 heartbeater.cc:511] Master 127.8.5.254:45165 requested a full tablet report, sending...
I20260809 03:27:15.668754 28838 ts_manager.cc:194] Registered new tserver with Master: c84bd881133d473e93cecfafb23be1c1 (127.8.5.193:43103)
I20260809 03:27:15.669677 28838 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.193@KRBTEST.COM'} at 127.8.5.193:42401
WARNING: no policy specified for kudu/127.8.5.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
Entry for principal kudu/127.8.5.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab.
I20260809 03:27:15.690156 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:45165
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:15.770184 29047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:15.770418 29047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:15.770457 29047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:15.771586 29047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:15.771656 29047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:15.771699 29047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:27:15.773102 29047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.194.keytab
--principal=kudu/127.8.5.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:45165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:15.773366 29047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:15.773599 29047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:15.778553 29053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:15.778613 29047 server_base.cc:1034] running on GCE node
W20260809 03:27:15.778561 29054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:15.778561 29056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:15.779033 29047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:15.779274 29047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:15.780437 29047 hybrid_clock.cc:648] HybridClock initialized: now 1786246035780428 us; error 27 us; skew 500 ppm
Aug 09 03:27:15 dist-test-slave-2w3w krb5kdc[28791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246035, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:15.783097 29047 init.cc:377] Logged in from keytab as kudu/127.8.5.194@KRBTEST.COM (short username kudu)
I20260809 03:27:15.783473 29047 webserver.cc:460] Webserver started at http://127.8.5.194:36941/ using document root <none> and password file <none>
I20260809 03:27:15.783694 29047 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:15.783762 29047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:15.783921 29047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:15.784935 29047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "c9fbed285d9748cc969bc6f9dd44421b"
format_stamp: "Formatted at 2026-08-09 03:27:15 on dist-test-slave-2w3w"
server_key: "0e79582959e0d8fe247a06140de6f1bb"
server_key_iv: "df0f492afb78c8ac3e99cc1f040ac2b3"
server_key_version: "encryptionkey@0"
I20260809 03:27:15.785286 29047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "c9fbed285d9748cc969bc6f9dd44421b"
format_stamp: "Formatted at 2026-08-09 03:27:15 on dist-test-slave-2w3w"
server_key: "0e79582959e0d8fe247a06140de6f1bb"
server_key_iv: "df0f492afb78c8ac3e99cc1f040ac2b3"
server_key_version: "encryptionkey@0"
I20260809 03:27:15.786660 29047 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:27:15.787451 29064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:15.787629 29047 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:15.787729 29047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "c9fbed285d9748cc969bc6f9dd44421b"
format_stamp: "Formatted at 2026-08-09 03:27:15 on dist-test-slave-2w3w"
server_key: "0e79582959e0d8fe247a06140de6f1bb"
server_key_iv: "df0f492afb78c8ac3e99cc1f040ac2b3"
server_key_version: "encryptionkey@0"
I20260809 03:27:15.787808 29047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:15.819453 29047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:15.821883 29047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:15.822064 29047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:15.822330 29047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:27:15.822652 29047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:27:15.822705 29047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:15.822747 29047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:27:15.822804 29047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:15.828682 29047 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:33807
I20260809 03:27:15.828778 29185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:33807 every 8 connection(s)
I20260809 03:27:15.829084 29047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
Aug 09 03:27:15 dist-test-slave-2w3w krb5kdc[28791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246035, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.194@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:15.835525 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 29047
I20260809 03:27:15.835656 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:27:15.835948 8215 external_mini_cluster.cc:1428] Setting key 2453720373caf2d40e502c3e27ccdb91
I20260809 03:27:15.838500 28879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:15.829822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:59641 (local address 127.8.5.254:45165)
0809 03:27:15.829877 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:15.829880 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:15.830094 (+ 214us) server_negotiation.cc:407] Connection header received
0809 03:27:15.830579 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:15.830580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:15.830589 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:15.830643 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:15.831615 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:15.832130 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:15.833100 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:15.833291 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:15.833360 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:15.835517 (+ 2157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:15.835518 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:15.835519 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:15.835527 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:15.837248 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:15.837605 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:15.837606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:15.837606 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:15.837665 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:15.837857 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:15.837857 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:15.837858 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:15.837990 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:15.838055 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:15.838283 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 03:27:15.838370 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 03:27:15.838907 29188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:15.829791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:45165 (local address 127.8.5.194:59641)
0809 03:27:15.829974 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:15.830021 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:15.830493 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:15.830704 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:15.830707 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:15.831341 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:15.831531 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:15.831536 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:15.832212 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:15.832213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:15.833026 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:15.833027 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:15.833379 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:15.833379 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:15.833533 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:15.833976 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:15.833984 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:15.835425 (+ 1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:15.837322 (+ 1897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:15.837328 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:15.837329 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:15.837534 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:15.837725 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:15.837725 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:15.837726 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:15.837802 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:15.838051 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:15.838056 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:15.838161 (+ 105us) client_negotiation.cc:769] Sending connection context
0809 03:27:15.838240 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 03:27:15.838376 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":104,"threads_started":1}
I20260809 03:27:15.839432 29186 heartbeater.cc:347] Connected to a master server at 127.8.5.254:45165
I20260809 03:27:15.839541 29186 heartbeater.cc:464] Registering TS with master...
I20260809 03:27:15.839723 29186 heartbeater.cc:511] Master 127.8.5.254:45165 requested a full tablet report, sending...
I20260809 03:27:15.840116 28838 ts_manager.cc:194] Registered new tserver with Master: c9fbed285d9748cc969bc6f9dd44421b (127.8.5.194:33807)
I20260809 03:27:15.840494 28838 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.194@KRBTEST.COM'} at 127.8.5.194:59641
WARNING: no policy specified for kudu/127.8.5.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
Entry for principal kudu/127.8.5.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab.
I20260809 03:27:15.861701 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:45165
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:15.943835 29191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:15.944034 29191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:15.944057 29191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:15.945182 29191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:15.945222 29191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:15.945284 29191 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:27:15.946704 29191 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.195.keytab
--principal=kudu/127.8.5.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:45165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:15.946938 29191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:15.947216 29191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:15.952059 29197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:15.952047 29198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:15.952251 29191 server_base.cc:1034] running on GCE node
W20260809 03:27:15.952060 29200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:15.952526 29191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:15.952724 29191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:15.953940 29191 hybrid_clock.cc:648] HybridClock initialized: now 1786246035953925 us; error 25 us; skew 500 ppm
Aug 09 03:27:15 dist-test-slave-2w3w krb5kdc[28791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246035, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:15.956537 29191 init.cc:377] Logged in from keytab as kudu/127.8.5.195@KRBTEST.COM (short username kudu)
I20260809 03:27:15.957016 29191 webserver.cc:460] Webserver started at http://127.8.5.195:40411/ using document root <none> and password file <none>
I20260809 03:27:15.957263 29191 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:15.957335 29191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:15.957484 29191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:15.958556 29191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "150be0f7082549f19728a88fc3c7d1b6"
format_stamp: "Formatted at 2026-08-09 03:27:15 on dist-test-slave-2w3w"
server_key: "851ba9768b56b4cce416c9c00a8f013e"
server_key_iv: "0d60774bd55f5bf17cf8f21f377f2166"
server_key_version: "encryptionkey@0"
I20260809 03:27:15.958920 29191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "150be0f7082549f19728a88fc3c7d1b6"
format_stamp: "Formatted at 2026-08-09 03:27:15 on dist-test-slave-2w3w"
server_key: "851ba9768b56b4cce416c9c00a8f013e"
server_key_iv: "0d60774bd55f5bf17cf8f21f377f2166"
server_key_version: "encryptionkey@0"
I20260809 03:27:15.960275 29191 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:27:15.961000 29207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:15.961166 29191 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:27:15.961267 29191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "150be0f7082549f19728a88fc3c7d1b6"
format_stamp: "Formatted at 2026-08-09 03:27:15 on dist-test-slave-2w3w"
server_key: "851ba9768b56b4cce416c9c00a8f013e"
server_key_iv: "0d60774bd55f5bf17cf8f21f377f2166"
server_key_version: "encryptionkey@0"
I20260809 03:27:15.961349 29191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:15.976904 29191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:15.978675 29191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:15.978842 29191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:15.979156 29191 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:27:15.979465 29191 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:27:15.979521 29191 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:15.979565 29191 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:27:15.979589 29191 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:15.985575 29191 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:40091
I20260809 03:27:15.985621 29329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:40091 every 8 connection(s)
I20260809 03:27:15.985975 29191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:27:15.986567 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 29191
I20260809 03:27:15.986682 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:27:15.986861 8215 external_mini_cluster.cc:1428] Setting key af31835ca17c9ee6ce3ce3ea20a52b14
Aug 09 03:27:15 dist-test-slave-2w3w krb5kdc[28791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246035, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.195@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:15.995652 28879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:15.986724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:36369 (local address 127.8.5.254:45165)
0809 03:27:15.986778 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:15.986780 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:15.986989 (+ 209us) server_negotiation.cc:407] Connection header received
0809 03:27:15.987660 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:15.987679 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:15.987691 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:15.987756 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:15.988722 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:15.989323 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:15.990284 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:15.990548 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:15.990624 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:15.992825 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:15.992826 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:15.992827 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:15.992834 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:15.994256 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:15.994654 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:15.994656 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:15.994656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:15.994716 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:15.995019 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:15.995020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:15.995020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:15.995136 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:15.995213 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:15.995487 (+ 274us) server_negotiation.cc:299] Negotiation successful
0809 03:27:15.995564 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 03:27:15.995827 29332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:15.986692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:45165 (local address 127.8.5.195:36369)
0809 03:27:15.986857 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:15.986899 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:15.987559 (+ 660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:15.987809 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:15.987811 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:15.988362 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:15.988549 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:15.988553 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:15.989409 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:15.989410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:15.990209 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:15.990212 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:15.990632 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:15.990634 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:15.990766 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:15.991336 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:15.991346 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:15.992723 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:15.994345 (+ 1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:15.994352 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:15.994355 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:15.994577 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:15.994798 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:15.994799 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:15.994799 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:15.994912 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:15.995205 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:15.995211 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:15.995354 (+ 143us) client_negotiation.cc:769] Sending connection context
0809 03:27:15.995453 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 03:27:15.995603 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":81,"threads_started":1}
I20260809 03:27:15.996289 29330 heartbeater.cc:347] Connected to a master server at 127.8.5.254:45165
I20260809 03:27:15.996371 29330 heartbeater.cc:464] Registering TS with master...
I20260809 03:27:15.996567 29330 heartbeater.cc:511] Master 127.8.5.254:45165 requested a full tablet report, sending...
I20260809 03:27:15.996933 28838 ts_manager.cc:194] Registered new tserver with Master: 150be0f7082549f19728a88fc3c7d1b6 (127.8.5.195:40091)
I20260809 03:27:15.997262 28838 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.5.195@KRBTEST.COM'} at 127.8.5.195:36369
I20260809 03:27:15.998548 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:27:16.005669 28879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:15.999841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49930 (local address 127.8.5.254:45165)
0809 03:27:15.999913 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:15.999915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:16.000036 (+ 121us) server_negotiation.cc:407] Connection header received
0809 03:27:16.000122 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:16.000123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:16.000133 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:16.000206 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:16.000742 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.001195 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.002008 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.002193 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.002268 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.003444 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:16.003445 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:16.003446 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:16.003452 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:16.004537 (+ 1085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:16.004873 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:16.004874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:16.004874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:16.004930 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:16.005145 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:16.005146 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:16.005146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:16.005286 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:16.005402 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:16.005497 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 03:27:16.005572 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 03:27:16.007082 28838 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49930:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:27:16.008538 28838 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:27:16.015264 29346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.011025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39922 (local address 127.8.5.195:40091)
0809 03:27:16.011184 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:16.011188 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:16.011546 (+ 358us) server_negotiation.cc:407] Connection header received
0809 03:27:16.011614 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:16.011616 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:16.011631 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:16.011704 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:16.011943 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.013070 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.014289 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.014794 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.014898 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.014977 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:16.015139 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 03:27:16.015180 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":92,"threads_started":1}
I20260809 03:27:16.015266 29345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.010631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:40091 (local address 127.0.0.1:39922)
0809 03:27:16.011485 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:16.011495 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:16.011548 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:16.011807 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:16.011808 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:16.011810 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:16.011863 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.011865 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.013163 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.013164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.014212 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.014215 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.014906 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.014907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.015011 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.015025 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 03:27:16.015121 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 03:27:16.015184 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":833,"mutex_wait_us":2,"thread_start_us":82,"threads_started":1}
I20260809 03:27:16.015455 29344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.010749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58156 (local address 127.8.5.193:43103)
0809 03:27:16.011235 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:16.011239 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:16.011248 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:27:16.011290 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:16.011291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:16.011304 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:16.011372 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:16.011553 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.012462 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.014094 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.014825 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.014897 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.014951 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:16.015173 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 03:27:16.015220 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":140,"threads_started":1}
I20260809 03:27:16.015561 29343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.010611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:43103 (local address 127.0.0.1:58156)
0809 03:27:16.010766 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:16.010807 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:16.010874 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:16.011394 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:16.011397 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:16.011399 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:16.011446 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.011447 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.012563 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.012564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.014008 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.014011 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.015012 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.015013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.015077 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.015081 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:27:16.015124 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 03:27:16.015493 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":321,"thread_start_us":60,"threads_started":1}
I20260809 03:27:16.015982 29257 tablet_service.cc:1467] Processing CreateTablet for tablet c426a17ce5284467ac3c3eb61c954f41 (DEFAULT_TABLE table=test-table [id=6a989776852849b1b037daea8579b37e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:27:16.016181 28969 tablet_service.cc:1467] Processing CreateTablet for tablet c426a17ce5284467ac3c3eb61c954f41 (DEFAULT_TABLE table=test-table [id=6a989776852849b1b037daea8579b37e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:27:16.016350 29257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c426a17ce5284467ac3c3eb61c954f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:16.016517 28969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c426a17ce5284467ac3c3eb61c954f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:16.018919 29348 tablet_bootstrap.cc:492] T c426a17ce5284467ac3c3eb61c954f41 P c84bd881133d473e93cecfafb23be1c1: Bootstrap starting.
I20260809 03:27:16.019229 29347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.011022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51600 (local address 127.8.5.194:33807)
0809 03:27:16.011186 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:16.011191 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:16.011738 (+ 547us) server_negotiation.cc:407] Connection header received
0809 03:27:16.011785 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:16.011787 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:16.011802 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:16.011890 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:16.012048 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.013113 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.014308 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.015058 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.015121 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.015174 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:16.015641 (+ 467us) server_negotiation.cc:299] Negotiation successful
0809 03:27:16.019168 (+ 3527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":93,"threads_started":1}
I20260809 03:27:16.019399 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.010817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:33807 (local address 127.0.0.1:51600)
0809 03:27:16.011628 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:16.011636 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:16.011677 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:16.011904 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:16.011905 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:16.011908 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:16.011948 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.011949 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.013220 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.013221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.014217 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.014220 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.015206 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.015207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.015256 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.015259 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:27:16.015305 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 03:27:16.015346 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":801,"mutex_wait_us":3,"thread_start_us":88,"threads_started":1}
I20260809 03:27:16.019644 29348 tablet_bootstrap.cc:654] T c426a17ce5284467ac3c3eb61c954f41 P c84bd881133d473e93cecfafb23be1c1: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:16.019969 29113 tablet_service.cc:1467] Processing CreateTablet for tablet c426a17ce5284467ac3c3eb61c954f41 (DEFAULT_TABLE table=test-table [id=6a989776852849b1b037daea8579b37e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:27:16.020146 29348 log.cc:824] T c426a17ce5284467ac3c3eb61c954f41 P c84bd881133d473e93cecfafb23be1c1: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:16.020211 29113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c426a17ce5284467ac3c3eb61c954f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:16.020453 29349 tablet_bootstrap.cc:492] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6: Bootstrap starting.
I20260809 03:27:16.020967 29348 tablet_bootstrap.cc:492] T c426a17ce5284467ac3c3eb61c954f41 P c84bd881133d473e93cecfafb23be1c1: No bootstrap required, opened a new log
I20260809 03:27:16.021081 29349 tablet_bootstrap.cc:654] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:16.021090 29348 ts_tablet_manager.cc:1397] T c426a17ce5284467ac3c3eb61c954f41 P c84bd881133d473e93cecfafb23be1c1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 03:27:16.021617 29349 log.cc:824] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:16.022467 29349 tablet_bootstrap.cc:492] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6: No bootstrap required, opened a new log
I20260809 03:27:16.022540 29349 ts_tablet_manager.cc:1397] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:27:16.022925 29352 tablet_bootstrap.cc:492] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b: Bootstrap starting.
I20260809 03:27:16.023458 29352 tablet_bootstrap.cc:654] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:16.023475 29348 raft_consensus.cc:348] T c426a17ce5284467ac3c3eb61c954f41 P c84bd881133d473e93cecfafb23be1c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84bd881133d473e93cecfafb23be1c1" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 43103 } } peers { permanent_uuid: "150be0f7082549f19728a88fc3c7d1b6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 40091 } } peers { permanent_uuid: "c9fbed285d9748cc969bc6f9dd44421b" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33807 } }
I20260809 03:27:16.023648 29348 raft_consensus.cc:374] T c426a17ce5284467ac3c3eb61c954f41 P c84bd881133d473e93cecfafb23be1c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:16.023692 29348 raft_consensus.cc:729] T c426a17ce5284467ac3c3eb61c954f41 P c84bd881133d473e93cecfafb23be1c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84bd881133d473e93cecfafb23be1c1, State: Initialized, Role: FOLLOWER
I20260809 03:27:16.023823 29348 consensus_queue.cc:260] T c426a17ce5284467ac3c3eb61c954f41 P c84bd881133d473e93cecfafb23be1c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84bd881133d473e93cecfafb23be1c1" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 43103 } } peers { permanent_uuid: "150be0f7082549f19728a88fc3c7d1b6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 40091 } } peers { permanent_uuid: "c9fbed285d9748cc969bc6f9dd44421b" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33807 } }
I20260809 03:27:16.024049 29352 log.cc:824] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:16.024109 29348 ts_tablet_manager.cc:1428] T c426a17ce5284467ac3c3eb61c954f41 P c84bd881133d473e93cecfafb23be1c1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 03:27:16.024274 29042 heartbeater.cc:503] Master 127.8.5.254:45165 was elected leader, sending a full tablet report...
I20260809 03:27:16.024574 29349 raft_consensus.cc:348] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84bd881133d473e93cecfafb23be1c1" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 43103 } } peers { permanent_uuid: "150be0f7082549f19728a88fc3c7d1b6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 40091 } } peers { permanent_uuid: "c9fbed285d9748cc969bc6f9dd44421b" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33807 } }
I20260809 03:27:16.024751 29349 raft_consensus.cc:374] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:16.024799 29349 raft_consensus.cc:729] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150be0f7082549f19728a88fc3c7d1b6, State: Initialized, Role: FOLLOWER
I20260809 03:27:16.024837 29352 tablet_bootstrap.cc:492] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b: No bootstrap required, opened a new log
I20260809 03:27:16.024916 29352 ts_tablet_manager.cc:1397] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:27:16.024901 29349 consensus_queue.cc:260] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84bd881133d473e93cecfafb23be1c1" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 43103 } } peers { permanent_uuid: "150be0f7082549f19728a88fc3c7d1b6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 40091 } } peers { permanent_uuid: "c9fbed285d9748cc969bc6f9dd44421b" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33807 } }
I20260809 03:27:16.025166 29349 ts_tablet_manager.cc:1428] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 03:27:16.025204 29330 heartbeater.cc:503] Master 127.8.5.254:45165 was elected leader, sending a full tablet report...
I20260809 03:27:16.026788 29352 raft_consensus.cc:348] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84bd881133d473e93cecfafb23be1c1" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 43103 } } peers { permanent_uuid: "150be0f7082549f19728a88fc3c7d1b6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 40091 } } peers { permanent_uuid: "c9fbed285d9748cc969bc6f9dd44421b" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33807 } }
I20260809 03:27:16.026924 29352 raft_consensus.cc:374] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:16.026947 29352 raft_consensus.cc:729] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9fbed285d9748cc969bc6f9dd44421b, State: Initialized, Role: FOLLOWER
I20260809 03:27:16.027089 29352 consensus_queue.cc:260] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84bd881133d473e93cecfafb23be1c1" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 43103 } } peers { permanent_uuid: "150be0f7082549f19728a88fc3c7d1b6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 40091 } } peers { permanent_uuid: "c9fbed285d9748cc969bc6f9dd44421b" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33807 } }
I20260809 03:27:16.027283 29352 ts_tablet_manager.cc:1428] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260809 03:27:16.027411 29186 heartbeater.cc:503] Master 127.8.5.254:45165 was elected leader, sending a full tablet report...
I20260809 03:27:16.062462 29355 raft_consensus.cc:482] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:27:16.062579 29355 raft_consensus.cc:504] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84bd881133d473e93cecfafb23be1c1" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 43103 } } peers { permanent_uuid: "150be0f7082549f19728a88fc3c7d1b6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 40091 } } peers { permanent_uuid: "c9fbed285d9748cc969bc6f9dd44421b" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33807 } }
I20260809 03:27:16.062999 29355 leader_election.cc:288] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c84bd881133d473e93cecfafb23be1c1 (127.8.5.193:43103), c9fbed285d9748cc969bc6f9dd44421b (127.8.5.194:33807)
I20260809 03:27:16.066980 29344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.063234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:50465 (local address 127.8.5.193:43103)
0809 03:27:16.063366 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:16.063368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:16.063376 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:27:16.063448 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:16.063450 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:16.063462 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:16.063527 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:16.063735 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.064483 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.066029 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.066598 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.066674 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.066685 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:16.066852 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 03:27:16.066893 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 03:27:16.066980 29347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.063276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:40611 (local address 127.8.5.194:33807)
0809 03:27:16.063343 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:16.063344 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:16.063414 (+ 70us) server_negotiation.cc:407] Connection header received
0809 03:27:16.063462 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:16.063463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:16.063476 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:16.063527 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:16.063727 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.064468 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.066030 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.066598 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.066674 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.066685 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:16.066852 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 03:27:16.066893 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:27:16.066993 29332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.063160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:43103 (local address 127.8.5.195:50465)
0809 03:27:16.063322 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:16.063334 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:16.063383 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:16.063544 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:16.063545 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:16.063546 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:16.063649 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.063650 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.064561 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.064562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.065939 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.065942 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.066682 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.066683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.066767 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.066771 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:27:16.066828 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 03:27:16.066882 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":85,"thread_start_us":106,"threads_started":1}
I20260809 03:27:16.067005 29357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.063146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:33807 (local address 127.8.5.195:40611)
0809 03:27:16.063322 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:16.063334 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:16.063401 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:16.063544 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:16.063545 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:16.063546 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:16.063649 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.063650 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.064561 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.064562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.065939 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.065942 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.066682 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.066683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.066767 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.066771 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:27:16.066829 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 03:27:16.066876 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":120}
I20260809 03:27:16.067343 28991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c426a17ce5284467ac3c3eb61c954f41" candidate_uuid: "150be0f7082549f19728a88fc3c7d1b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84bd881133d473e93cecfafb23be1c1" is_pre_election: true
I20260809 03:27:16.067514 28991 raft_consensus.cc:2454] T c426a17ce5284467ac3c3eb61c954f41 P c84bd881133d473e93cecfafb23be1c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150be0f7082549f19728a88fc3c7d1b6 in term 0.
I20260809 03:27:16.067589 29133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c426a17ce5284467ac3c3eb61c954f41" candidate_uuid: "150be0f7082549f19728a88fc3c7d1b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9fbed285d9748cc969bc6f9dd44421b" is_pre_election: true
I20260809 03:27:16.067750 29133 raft_consensus.cc:2454] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150be0f7082549f19728a88fc3c7d1b6 in term 0.
I20260809 03:27:16.067790 29208 leader_election.cc:302] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150be0f7082549f19728a88fc3c7d1b6, c84bd881133d473e93cecfafb23be1c1; no voters:
I20260809 03:27:16.067938 29355 raft_consensus.cc:2781] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:27:16.067998 29355 raft_consensus.cc:482] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:27:16.068015 29355 raft_consensus.cc:3037] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:16.068728 29355 raft_consensus.cc:504] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84bd881133d473e93cecfafb23be1c1" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 43103 } } peers { permanent_uuid: "150be0f7082549f19728a88fc3c7d1b6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 40091 } } peers { permanent_uuid: "c9fbed285d9748cc969bc6f9dd44421b" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33807 } }
I20260809 03:27:16.068868 29355 leader_election.cc:288] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [CANDIDATE]: Term 1 election: Requested vote from peers c84bd881133d473e93cecfafb23be1c1 (127.8.5.193:43103), c9fbed285d9748cc969bc6f9dd44421b (127.8.5.194:33807)
I20260809 03:27:16.069025 28991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c426a17ce5284467ac3c3eb61c954f41" candidate_uuid: "150be0f7082549f19728a88fc3c7d1b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84bd881133d473e93cecfafb23be1c1"
I20260809 03:27:16.069110 28991 raft_consensus.cc:3037] T c426a17ce5284467ac3c3eb61c954f41 P c84bd881133d473e93cecfafb23be1c1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:16.069092 29133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c426a17ce5284467ac3c3eb61c954f41" candidate_uuid: "150be0f7082549f19728a88fc3c7d1b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9fbed285d9748cc969bc6f9dd44421b"
I20260809 03:27:16.069185 29133 raft_consensus.cc:3037] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:16.069861 28991 raft_consensus.cc:2454] T c426a17ce5284467ac3c3eb61c954f41 P c84bd881133d473e93cecfafb23be1c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150be0f7082549f19728a88fc3c7d1b6 in term 1.
I20260809 03:27:16.069906 29133 raft_consensus.cc:2454] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150be0f7082549f19728a88fc3c7d1b6 in term 1.
I20260809 03:27:16.070055 29208 leader_election.cc:302] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150be0f7082549f19728a88fc3c7d1b6, c84bd881133d473e93cecfafb23be1c1; no voters:
I20260809 03:27:16.070187 29355 raft_consensus.cc:2781] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:16.070379 29355 raft_consensus.cc:686] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [term 1 LEADER]: Becoming Leader. State: Replica: 150be0f7082549f19728a88fc3c7d1b6, State: Running, Role: LEADER
I20260809 03:27:16.070478 29355 consensus_queue.cc:237] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84bd881133d473e93cecfafb23be1c1" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 43103 } } peers { permanent_uuid: "150be0f7082549f19728a88fc3c7d1b6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 40091 } } peers { permanent_uuid: "c9fbed285d9748cc969bc6f9dd44421b" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33807 } }
I20260809 03:27:16.071331 28837 catalog_manager.cc:5495] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 150be0f7082549f19728a88fc3c7d1b6 (127.8.5.195). New cstate: current_term: 1 leader_uuid: "150be0f7082549f19728a88fc3c7d1b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84bd881133d473e93cecfafb23be1c1" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 43103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150be0f7082549f19728a88fc3c7d1b6" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 40091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9fbed285d9748cc969bc6f9dd44421b" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33807 } health_report { overall_health: UNKNOWN } } }
W20260809 03:27:16.079630 29187 tablet.cc:2369] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:27:16.088347 29346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.086096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39936 (local address 127.8.5.195:40091)
0809 03:27:16.086149 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:16.086151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:16.086160 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:27:16.086214 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:16.086215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:16.086231 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:16.086290 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:27:16.086413 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.086873 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.087655 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.087831 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.087895 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.088024 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:27:16.088118 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:27:16.088178 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:16.088220 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 03:27:16.088235 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 03:27:16.090127 28991 raft_consensus.cc:1261] T c426a17ce5284467ac3c3eb61c954f41 P c84bd881133d473e93cecfafb23be1c1 [term 1 FOLLOWER]: Refusing update from remote peer 150be0f7082549f19728a88fc3c7d1b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:27:16.090127 29133 raft_consensus.cc:1261] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b [term 1 FOLLOWER]: Refusing update from remote peer 150be0f7082549f19728a88fc3c7d1b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:27:16.090530 29358 consensus_queue.cc:1035] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84bd881133d473e93cecfafb23be1c1" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 43103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:27:16.090670 29355 consensus_queue.cc:1035] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9fbed285d9748cc969bc6f9dd44421b" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:27:16.093109 29363 mvcc.cc:205] Tried to move back new op lower bound from 7316463763822202880 to 7316463763745456128. Current Snapshot: MvccSnapshot[applied={T|T < 7316463763822202880}]
I20260809 03:27:16.095747 28837 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:27:16.095829 28837 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:27:16.096609 28837 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a4adfd072eb40bd97c38b1b06698074: Sending DeleteTablet for 3 replicas of tablet c426a17ce5284467ac3c3eb61c954f41
I20260809 03:27:16.096942 29257 tablet_service.cc:1514] Processing DeleteTablet for tablet c426a17ce5284467ac3c3eb61c954f41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:27:16 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:39922
I20260809 03:27:16.096957 28969 tablet_service.cc:1514] Processing DeleteTablet for tablet c426a17ce5284467ac3c3eb61c954f41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:27:16 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:58156
I20260809 03:27:16.096992 29113 tablet_service.cc:1514] Processing DeleteTablet for tablet c426a17ce5284467ac3c3eb61c954f41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:27:16 UTC) from {username='kudu', principal='kudu/127.8.5.254@KRBTEST.COM'} at 127.0.0.1:51600
I20260809 03:27:16.097368 29375 tablet_replica.cc:330] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b: stopping tablet replica
I20260809 03:27:16.097502 29375 raft_consensus.cc:2229] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:27:16.097515 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 28903
I20260809 03:27:16.098459 29375 raft_consensus.cc:2258] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:27:16.097187 29373 tablet_replica.cc:330] T c426a17ce5284467ac3c3eb61c954f41 P c84bd881133d473e93cecfafb23be1c1: stopping tablet replica
I20260809 03:27:16.100347 29374 tablet_replica.cc:330] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6: stopping tablet replica
I20260809 03:27:16.100445 29374 raft_consensus.cc:2229] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 03:27:16.100534 29374 raft_consensus.cc:2258] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:27:16.100883 29374 ts_tablet_manager.cc:1905] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:27:16.102514 29374 ts_tablet_manager.cc:1918] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:27:16.102602 29374 log.cc:1196] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/c426a17ce5284467ac3c3eb61c954f41
I20260809 03:27:16.102872 29374 ts_tablet_manager.cc:1939] T c426a17ce5284467ac3c3eb61c954f41 P 150be0f7082549f19728a88fc3c7d1b6: Deleting consensus metadata
I20260809 03:27:16.103277 28825 catalog_manager.cc:4841] TS 150be0f7082549f19728a88fc3c7d1b6 (127.8.5.195:40091): tablet c426a17ce5284467ac3c3eb61c954f41 (table test-table [id=6a989776852849b1b037daea8579b37e]) successfully deleted
I20260809 03:27:16.104223 29375 ts_tablet_manager.cc:1905] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:27:16.105662 29375 ts_tablet_manager.cc:1918] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:27:16.105752 29375 log.cc:1196] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/c426a17ce5284467ac3c3eb61c954f41
I20260809 03:27:16.106030 29375 ts_tablet_manager.cc:1939] T c426a17ce5284467ac3c3eb61c954f41 P c9fbed285d9748cc969bc6f9dd44421b: Deleting consensus metadata
W20260809 03:27:16.106127 28822 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.5.193:43103 (error 108)
I20260809 03:27:16.106423 28825 catalog_manager.cc:4841] TS c9fbed285d9748cc969bc6f9dd44421b (127.8.5.194:33807): tablet c426a17ce5284467ac3c3eb61c954f41 (table test-table [id=6a989776852849b1b037daea8579b37e]) successfully deleted
I20260809 03:27:16.106662 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.106483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:43103 (local address 127.0.0.1:58170)
0809 03:27:16.106566 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:16.106606 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.193:43103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 03:27:16.106741 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 29047
W20260809 03:27:16.106789 28822 catalog_manager.cc:4584] TS c84bd881133d473e93cecfafb23be1c1 (127.8.5.193:43103): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c426a17ce5284467ac3c3eb61c954f41: Network error: Client connection negotiation failed: client connection to 127.8.5.193:43103: connect: Connection refused (error 111)
I20260809 03:27:16.113488 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 29191
I20260809 03:27:16.119843 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 28804
2026-08-09T03:27:16Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (1995 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T03:27:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:16Z Disabled control of system clock
I20260809 03:27:16.149355 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:38049
--webserver_interface=127.8.5.254
--webserver_port=0
--builtin_ntp_servers=127.8.5.212:46879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:38049
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 03:27:16.229833 29380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:16.230044 29380 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:16.230065 29380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:16.231142 29380 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:16.231176 29380 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:16.231189 29380 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:16.231201 29380 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:16.231225 29380 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:16.232482 29380 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:46879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:38049
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:38049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29380
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:16.232667 29380 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:16.232877 29380 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:16.237629 29385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:16.237680 29386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:16.237680 29388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:16.237839 29380 server_base.cc:1034] running on GCE node
I20260809 03:27:16.238071 29380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:16.238358 29380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:16.239534 29380 hybrid_clock.cc:648] HybridClock initialized: now 1786246036239519 us; error 37 us; skew 500 ppm
I20260809 03:27:16.240741 29380 webserver.cc:460] Webserver started at http://127.8.5.254:35017/ using document root <none> and password file <none>
I20260809 03:27:16.240973 29380 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:16.241043 29380 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:16.241209 29380 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:16.242216 29380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "9fb1cd546933455c9beea88e90e54294"
format_stamp: "Formatted at 2026-08-09 03:27:16 on dist-test-slave-2w3w"
server_key: "ddcccd3e97c4221fc0911532410e346e"
server_key_iv: "81e5c553bd683020d764008a59fa5eb4"
server_key_version: "encryptionkey@0"
I20260809 03:27:16.242590 29380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "9fb1cd546933455c9beea88e90e54294"
format_stamp: "Formatted at 2026-08-09 03:27:16 on dist-test-slave-2w3w"
server_key: "ddcccd3e97c4221fc0911532410e346e"
server_key_iv: "81e5c553bd683020d764008a59fa5eb4"
server_key_version: "encryptionkey@0"
I20260809 03:27:16.243986 29380 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:27:16.244675 29395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:16.244844 29380 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:27:16.244953 29380 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "9fb1cd546933455c9beea88e90e54294"
format_stamp: "Formatted at 2026-08-09 03:27:16 on dist-test-slave-2w3w"
server_key: "ddcccd3e97c4221fc0911532410e346e"
server_key_iv: "81e5c553bd683020d764008a59fa5eb4"
server_key_version: "encryptionkey@0"
I20260809 03:27:16.245025 29380 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:16.265301 29380 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:16.265615 29380 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:16.265769 29380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:16.269865 29380 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:38049
I20260809 03:27:16.269912 29450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:38049 every 8 connection(s)
I20260809 03:27:16.270260 29380 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:16.271253 29451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:16.273450 29451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294: Bootstrap starting.
I20260809 03:27:16.273741 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 29380
I20260809 03:27:16.273873 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:16.274070 8215 external_mini_cluster.cc:1428] Setting key f7e6e714bdee0835eabb3f186b241e44
I20260809 03:27:16.274107 29451 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:16.274478 29451 log.cc:824] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:16.275231 29451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294: No bootstrap required, opened a new log
I20260809 03:27:16.277375 29451 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fb1cd546933455c9beea88e90e54294" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38049 } }
I20260809 03:27:16.277540 29451 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:16.277571 29451 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb1cd546933455c9beea88e90e54294, State: Initialized, Role: FOLLOWER
I20260809 03:27:16.277683 29451 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fb1cd546933455c9beea88e90e54294" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38049 } }
I20260809 03:27:16.277757 29451 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:16.277794 29451 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:16.277853 29451 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:16.278474 29451 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fb1cd546933455c9beea88e90e54294" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38049 } }
I20260809 03:27:16.278591 29451 leader_election.cc:302] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9fb1cd546933455c9beea88e90e54294; no voters:
I20260809 03:27:16.278760 29451 leader_election.cc:288] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:16.278807 29456 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:16.278985 29456 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294 [term 1 LEADER]: Becoming Leader. State: Replica: 9fb1cd546933455c9beea88e90e54294, State: Running, Role: LEADER
I20260809 03:27:16.279076 29451 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:16.279086 29456 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fb1cd546933455c9beea88e90e54294" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38049 } }
I20260809 03:27:16.279458 29456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9fb1cd546933455c9beea88e90e54294" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fb1cd546933455c9beea88e90e54294" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38049 } } }
I20260809 03:27:16.279534 29456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:16.279668 29456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fb1cd546933455c9beea88e90e54294. Latest consensus state: current_term: 1 leader_uuid: "9fb1cd546933455c9beea88e90e54294" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fb1cd546933455c9beea88e90e54294" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38049 } } }
I20260809 03:27:16.279731 29456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:16.280230 29454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.274562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46784 (local address 127.8.5.254:38049)
0809 03:27:16.274753 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:16.274762 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:16.274795 (+ 33us) server_negotiation.cc:407] Connection header received
0809 03:27:16.275287 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:16.275295 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:16.275403 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:16.275519 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:16.275784 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.276638 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.277880 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.278314 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.278407 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.279277 (+ 870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:16.279284 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:16.279284 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:16.279489 (+ 205us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:16.279532 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:16.279549 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:16.279614 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:16.279929 (+ 315us) server_negotiation.cc:299] Negotiation successful
0809 03:27:16.280030 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":71,"threads_started":1}
I20260809 03:27:16.280465 29463 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:16.280931 29463 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:16.282699 29463 catalog_manager.cc:1347] Generated new cluster ID: b835db532e044f95beae07f25dc74e8f
I20260809 03:27:16.282775 29463 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:16.290309 29463 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:16.290946 29463 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:16.295933 29463 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294: Generated new TSK 0
I20260809 03:27:16.296108 29463 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:16.304760 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.193:0
--local_ip_for_outbound_sockets=127.8.5.193
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:38049
--builtin_ntp_servers=127.8.5.212:46879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 03:27:16.388316 29478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:16.388516 29478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:16.388537 29478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:16.389667 29478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:16.389706 29478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:16.389731 29478 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.193
I20260809 03:27:16.391139 29478 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:46879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.5.193
--webserver_port=0
--tserver_master_addrs=127.8.5.254:38049
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.193
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:16.391396 29478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:16.391703 29478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:16.396780 29484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:16.396808 29486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:16.397040 29478 server_base.cc:1034] running on GCE node
W20260809 03:27:16.397141 29483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:16.397360 29478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:16.397627 29478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:16.398790 29478 hybrid_clock.cc:648] HybridClock initialized: now 1786246036398775 us; error 32 us; skew 500 ppm
I20260809 03:27:16.400171 29478 webserver.cc:460] Webserver started at http://127.8.5.193:38249/ using document root <none> and password file <none>
I20260809 03:27:16.400451 29478 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:16.400527 29478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:16.400689 29478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:16.401755 29478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-0/data/instance:
uuid: "fa0e26ecaf214d2b8a020c04b8353946"
format_stamp: "Formatted at 2026-08-09 03:27:16 on dist-test-slave-2w3w"
server_key: "f924a60393b44d16a988a500aea3f506"
server_key_iv: "c2072a3af8ac43d24077efede0b54f42"
server_key_version: "encryptionkey@0"
I20260809 03:27:16.402114 29478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance:
uuid: "fa0e26ecaf214d2b8a020c04b8353946"
format_stamp: "Formatted at 2026-08-09 03:27:16 on dist-test-slave-2w3w"
server_key: "f924a60393b44d16a988a500aea3f506"
server_key_iv: "c2072a3af8ac43d24077efede0b54f42"
server_key_version: "encryptionkey@0"
I20260809 03:27:16.403650 29478 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 03:27:16.404417 29492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:16.404572 29478 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:27:16.404659 29478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-0/wal
uuid: "fa0e26ecaf214d2b8a020c04b8353946"
format_stamp: "Formatted at 2026-08-09 03:27:16 on dist-test-slave-2w3w"
server_key: "f924a60393b44d16a988a500aea3f506"
server_key_iv: "c2072a3af8ac43d24077efede0b54f42"
server_key_version: "encryptionkey@0"
I20260809 03:27:16.404712 29478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:16.416765 29478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:16.417029 29478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:16.417128 29478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:16.417294 29478 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:27:16.417546 29478 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:27:16.417574 29478 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:16.417594 29478 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:27:16.417606 29478 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:16.423488 29478 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.193:39783
I20260809 03:27:16.423542 29615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.193:39783 every 8 connection(s)
I20260809 03:27:16.423864 29478 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-0/data/info.pb
I20260809 03:27:16.428982 29454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.424565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:46477 (local address 127.8.5.254:38049)
0809 03:27:16.424608 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:16.424611 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:16.424868 (+ 257us) server_negotiation.cc:407] Connection header received
0809 03:27:16.425329 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:16.425330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:16.425342 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:16.425391 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:16.426023 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.426539 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.427647 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.427874 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.427943 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.428735 (+ 792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:16.428736 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:16.428736 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:16.428740 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:16.428756 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:16.428760 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:16.428811 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:16.428899 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 03:27:16.428922 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:27:16.429220 29618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.424549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38049 (local address 127.8.5.193:46477)
0809 03:27:16.424732 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:16.424763 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:16.425249 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:16.425450 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:16.425453 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:16.425462 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:16.425954 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.425958 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.426649 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.426650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.427558 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.427560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.427969 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.427970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.428087 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.428581 (+ 494us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:27:16.428582 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:16.428610 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:27:16.428632 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:16.428824 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:16.428829 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:16.428832 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:27:16.428885 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 03:27:16.428965 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":98,"threads_started":1}
I20260809 03:27:16.429809 29616 heartbeater.cc:347] Connected to a master server at 127.8.5.254:38049
I20260809 03:27:16.429930 29616 heartbeater.cc:464] Registering TS with master...
I20260809 03:27:16.430135 29616 heartbeater.cc:511] Master 127.8.5.254:38049 requested a full tablet report, sending...
I20260809 03:27:16.430161 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 29478
I20260809 03:27:16.430261 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-0/wal/instance
I20260809 03:27:16.430474 8215 external_mini_cluster.cc:1428] Setting key d30e8c29b99e673c83a28f2a8489df2c
I20260809 03:27:16.430815 29412 ts_manager.cc:194] Registered new tserver with Master: fa0e26ecaf214d2b8a020c04b8353946 (127.8.5.193:39783)
I20260809 03:27:16.431763 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.194:0
--local_ip_for_outbound_sockets=127.8.5.194
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:38049
--builtin_ntp_servers=127.8.5.212:46879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 03:27:16.431826 29412 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.5.193:46477
W20260809 03:27:16.513928 29619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:16.514122 29619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:16.514143 29619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:16.515250 29619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:16.515283 29619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:16.515307 29619 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.194
I20260809 03:27:16.516570 29619 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:46879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.5.194
--webserver_port=0
--tserver_master_addrs=127.8.5.254:38049
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.194
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:16.516791 29619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:16.517091 29619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:16.522204 29625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:16.522228 29627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:16.522264 29619 server_base.cc:1034] running on GCE node
W20260809 03:27:16.522228 29624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:16.522655 29619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:16.522914 29619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:16.524089 29619 hybrid_clock.cc:648] HybridClock initialized: now 1786246036524080 us; error 33 us; skew 500 ppm
I20260809 03:27:16.525358 29619 webserver.cc:460] Webserver started at http://127.8.5.194:36715/ using document root <none> and password file <none>
I20260809 03:27:16.525650 29619 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:16.525724 29619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:16.525894 29619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:16.527051 29619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-1/data/instance:
uuid: "98ffdea7942a41a5ab5287a8da4347e4"
format_stamp: "Formatted at 2026-08-09 03:27:16 on dist-test-slave-2w3w"
server_key: "53267dc463f6e2364ffd6b4dc7cf4d0d"
server_key_iv: "7effa5178444916d587939c04f0180ce"
server_key_version: "encryptionkey@0"
I20260809 03:27:16.527438 29619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance:
uuid: "98ffdea7942a41a5ab5287a8da4347e4"
format_stamp: "Formatted at 2026-08-09 03:27:16 on dist-test-slave-2w3w"
server_key: "53267dc463f6e2364ffd6b4dc7cf4d0d"
server_key_iv: "7effa5178444916d587939c04f0180ce"
server_key_version: "encryptionkey@0"
I20260809 03:27:16.528802 29619 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:27:16.529496 29633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:16.529670 29619 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:16.529768 29619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-1/wal
uuid: "98ffdea7942a41a5ab5287a8da4347e4"
format_stamp: "Formatted at 2026-08-09 03:27:16 on dist-test-slave-2w3w"
server_key: "53267dc463f6e2364ffd6b4dc7cf4d0d"
server_key_iv: "7effa5178444916d587939c04f0180ce"
server_key_version: "encryptionkey@0"
I20260809 03:27:16.529850 29619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:16.551390 29619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:16.551708 29619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:16.551873 29619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:16.552116 29619 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:27:16.552461 29619 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:27:16.552515 29619 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:16.552551 29619 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:27:16.552578 29619 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:16.558348 29619 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.194:41529
I20260809 03:27:16.558451 29757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.194:41529 every 8 connection(s)
I20260809 03:27:16.558756 29619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-1/data/info.pb
I20260809 03:27:16.563625 29454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.559493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.194:41881 (local address 127.8.5.254:38049)
0809 03:27:16.559576 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:16.559578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:16.559810 (+ 232us) server_negotiation.cc:407] Connection header received
0809 03:27:16.560280 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:16.560281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:16.560291 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:16.560351 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:16.560964 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.561464 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.562387 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.562566 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.562615 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.563406 (+ 791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:16.563407 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:16.563407 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:16.563411 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:16.563425 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:16.563429 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:16.563477 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:16.563544 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 03:27:16.563565 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 03:27:16.563831 29760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.559472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38049 (local address 127.8.5.194:41881)
0809 03:27:16.559686 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:16.559720 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:16.560197 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:16.560395 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:16.560398 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:16.560406 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:16.560896 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.560900 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.561544 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.561545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.562306 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.562309 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.562640 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.562640 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.562746 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.563262 (+ 516us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:27:16.563262 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:16.563290 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:27:16.563311 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:16.563479 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:16.563481 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:16.563483 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 03:27:16.563527 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 03:27:16.563600 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":109,"threads_started":1}
I20260809 03:27:16.564399 29758 heartbeater.cc:347] Connected to a master server at 127.8.5.254:38049
I20260809 03:27:16.564505 29758 heartbeater.cc:464] Registering TS with master...
I20260809 03:27:16.564646 29758 heartbeater.cc:511] Master 127.8.5.254:38049 requested a full tablet report, sending...
I20260809 03:27:16.565026 29412 ts_manager.cc:194] Registered new tserver with Master: 98ffdea7942a41a5ab5287a8da4347e4 (127.8.5.194:41529)
I20260809 03:27:16.565375 29412 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.5.194:41881
I20260809 03:27:16.567703 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 29619
I20260809 03:27:16.567785 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-1/wal/instance
I20260809 03:27:16.568029 8215 external_mini_cluster.cc:1428] Setting key 790c57ee49dcc81c65d74167ede56727
I20260809 03:27:16.568902 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.5.195:0
--local_ip_for_outbound_sockets=127.8.5.195
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:38049
--builtin_ntp_servers=127.8.5.212:46879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 03:27:16.650593 29761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:16.650827 29761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:16.650876 29761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:16.652053 29761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:16.652120 29761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:16.652163 29761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.5.195
I20260809 03:27:16.653522 29761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:46879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.5.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.5.195
--webserver_port=0
--tserver_master_addrs=127.8.5.254:38049
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.5.195
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:16.653790 29761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:16.654099 29761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:16.659148 29767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:16.659134 29769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:16.659139 29766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:16.659435 29761 server_base.cc:1034] running on GCE node
I20260809 03:27:16.659694 29761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:16.659931 29761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:16.661098 29761 hybrid_clock.cc:648] HybridClock initialized: now 1786246036661093 us; error 38 us; skew 500 ppm
I20260809 03:27:16.662328 29761 webserver.cc:460] Webserver started at http://127.8.5.195:34059/ using document root <none> and password file <none>
I20260809 03:27:16.662582 29761 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:16.662652 29761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:16.662804 29761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:16.664036 29761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-2/data/instance:
uuid: "2a45aa810eee41a5a1e24388b7ffe097"
format_stamp: "Formatted at 2026-08-09 03:27:16 on dist-test-slave-2w3w"
server_key: "294d177dacf0d3796c1847d8686f16f1"
server_key_iv: "ad99ace77a39cb9776cc67e2c42d443e"
server_key_version: "encryptionkey@0"
I20260809 03:27:16.664395 29761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance:
uuid: "2a45aa810eee41a5a1e24388b7ffe097"
format_stamp: "Formatted at 2026-08-09 03:27:16 on dist-test-slave-2w3w"
server_key: "294d177dacf0d3796c1847d8686f16f1"
server_key_iv: "ad99ace77a39cb9776cc67e2c42d443e"
server_key_version: "encryptionkey@0"
I20260809 03:27:16.665658 29761 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:27:16.666348 29775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:16.666518 29761 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:27:16.666616 29761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-2/wal
uuid: "2a45aa810eee41a5a1e24388b7ffe097"
format_stamp: "Formatted at 2026-08-09 03:27:16 on dist-test-slave-2w3w"
server_key: "294d177dacf0d3796c1847d8686f16f1"
server_key_iv: "ad99ace77a39cb9776cc67e2c42d443e"
server_key_version: "encryptionkey@0"
I20260809 03:27:16.666695 29761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:16.674582 29761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:16.674871 29761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:16.675069 29761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:16.675290 29761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 03:27:16.675621 29761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 03:27:16.675688 29761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:16.675730 29761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 03:27:16.675757 29761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:16.682322 29761 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.195:35221
I20260809 03:27:16.682374 29896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.195:35221 every 8 connection(s)
I20260809 03:27:16.682708 29761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-2/data/info.pb
I20260809 03:27:16.684405 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 29761
I20260809 03:27:16.684546 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-2/wal/instance
I20260809 03:27:16.684769 8215 external_mini_cluster.cc:1428] Setting key 03673d5786daf95346326df242453cdb
I20260809 03:27:16.689077 29454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.683485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.195:45787 (local address 127.8.5.254:38049)
0809 03:27:16.683535 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:16.683537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:16.683828 (+ 291us) server_negotiation.cc:407] Connection header received
0809 03:27:16.684557 (+ 729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:16.684558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:16.684571 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:16.684641 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:16.685684 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.686350 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.687538 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.687759 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.687845 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.688750 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:16.688752 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:16.688752 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:16.688757 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:16.688780 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:16.688784 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:16.688868 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:16.688968 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 03:27:16.688996 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 03:27:16.689335 29899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.683444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38049 (local address 127.8.5.195:45787)
0809 03:27:16.683675 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:16.683712 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:16.684416 (+ 704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:16.684731 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:16.684736 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:16.684749 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:16.685565 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.685581 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.686456 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.686457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.687437 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.687439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.687854 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.687855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.688003 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.688569 (+ 566us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 03:27:16.688569 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:16.688598 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 03:27:16.688622 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:16.688869 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:16.688876 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:16.688880 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:27:16.688970 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 03:27:16.689077 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":98,"threads_started":1}
I20260809 03:27:16.689853 29897 heartbeater.cc:347] Connected to a master server at 127.8.5.254:38049
I20260809 03:27:16.689934 29897 heartbeater.cc:464] Registering TS with master...
I20260809 03:27:16.690079 29897 heartbeater.cc:511] Master 127.8.5.254:38049 requested a full tablet report, sending...
I20260809 03:27:16.690403 29412 ts_manager.cc:194] Registered new tserver with Master: 2a45aa810eee41a5a1e24388b7ffe097 (127.8.5.195:35221)
I20260809 03:27:16.690793 29412 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.5.195:45787
I20260809 03:27:16.697048 8215 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 03:27:16.701107 29454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.698476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46788 (local address 127.8.5.254:38049)
0809 03:27:16.698552 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:16.698554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:16.698599 (+ 45us) server_negotiation.cc:407] Connection header received
0809 03:27:16.698641 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:16.698642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:16.698651 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:16.698697 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:16.698854 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.699386 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.700081 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.700260 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.700310 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.700884 (+ 574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:16.700885 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:16.700886 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:16.700890 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:16.700903 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:16.700907 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:16.700949 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:16.700983 (+ 34us) server_negotiation.cc:299] Negotiation successful
0809 03:27:16.701003 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 03:27:16.702514 29412 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46788:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 03:27:16.704243 29412 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 03:27:16.710551 29906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.706334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:41529 (local address 127.0.0.1:47786)
0809 03:27:16.706562 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:16.706605 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:16.706678 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:16.707125 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:16.707126 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:16.707129 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:16.707178 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.707180 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.708286 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.708288 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.709548 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.709551 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.710239 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.710240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.710325 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.710340 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 03:27:16.710408 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 03:27:16.710460 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":24,"thread_start_us":74,"threads_started":1}
I20260809 03:27:16.710661 29908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.706493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41684 (local address 127.8.5.195:35221)
0809 03:27:16.706687 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:16.706692 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:16.706822 (+ 130us) server_negotiation.cc:407] Connection header received
0809 03:27:16.706879 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:16.706882 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:16.706899 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:16.707244 (+ 345us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:16.707339 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.708466 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.709571 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.710324 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.710414 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.710506 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:16.710531 (+ 25us) server_negotiation.cc:299] Negotiation successful
0809 03:27:16.710576 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":103,"threads_started":1}
I20260809 03:27:16.710685 29905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.706538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:39783 (local address 127.0.0.1:42988)
0809 03:27:16.706787 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:16.706813 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:16.706854 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:16.707174 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:16.707175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:16.707177 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:16.707214 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.707215 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.708551 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.708552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.709598 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.709600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.710463 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.710464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.710528 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.710532 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 03:27:16.710563 (+ 31us) client_negotiation.cc:240] Negotiation successful
0809 03:27:16.710601 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":67,"threads_started":1}
I20260809 03:27:16.710675 29909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.706385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:35221 (local address 127.0.0.1:41684)
0809 03:27:16.706733 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:16.706744 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:16.706814 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:16.707084 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:16.707087 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:16.707089 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:16.707165 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.707167 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.708583 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.708584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.709486 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.709488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.710412 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.710413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.710464 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.710467 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:27:16.710508 (+ 41us) client_negotiation.cc:240] Negotiation successful
0809 03:27:16.710539 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":91,"threads_started":1}
I20260809 03:27:16.710904 29907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.706433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47786 (local address 127.8.5.194:41529)
0809 03:27:16.706938 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:16.706942 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:16.706952 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:27:16.707010 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:16.707012 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:16.707027 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:16.707259 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:16.707325 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.708207 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.709652 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.710150 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.710240 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.710335 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:16.710761 (+ 426us) server_negotiation.cc:299] Negotiation successful
0809 03:27:16.710813 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":100,"threads_started":1}
I20260809 03:27:16.711519 29910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.706742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42988 (local address 127.8.5.193:39783)
0809 03:27:16.707012 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:16.707017 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:16.707027 (+ 10us) server_negotiation.cc:407] Connection header received
0809 03:27:16.707064 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:16.707066 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:16.707081 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:16.707285 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:16.707339 (+ 54us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.708466 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.709676 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.710366 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.711270 (+ 904us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.711375 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:16.711402 (+ 27us) server_negotiation.cc:299] Negotiation successful
0809 03:27:16.711441 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":122,"threads_started":1}
I20260809 03:27:16.711625 29823 tablet_service.cc:1467] Processing CreateTablet for tablet 6306b1f38a4b44119bd557aae0232908 (DEFAULT_TABLE table=test-table [id=6ad4e58e9ced421cbb6cff54e141e752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:27:16.712028 29823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6306b1f38a4b44119bd557aae0232908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:16.712190 29543 tablet_service.cc:1467] Processing CreateTablet for tablet 6306b1f38a4b44119bd557aae0232908 (DEFAULT_TABLE table=test-table [id=6ad4e58e9ced421cbb6cff54e141e752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:27:16.712496 29543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6306b1f38a4b44119bd557aae0232908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:16.714650 29911 tablet_bootstrap.cc:492] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097: Bootstrap starting.
I20260809 03:27:16.714936 29912 tablet_bootstrap.cc:492] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946: Bootstrap starting.
I20260809 03:27:16.715188 29684 tablet_service.cc:1467] Processing CreateTablet for tablet 6306b1f38a4b44119bd557aae0232908 (DEFAULT_TABLE table=test-table [id=6ad4e58e9ced421cbb6cff54e141e752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 03:27:16.715526 29684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6306b1f38a4b44119bd557aae0232908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:16.715526 29911 tablet_bootstrap.cc:654] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:16.715554 29912 tablet_bootstrap.cc:654] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:16.715842 29912 log.cc:824] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:16.715896 29911 log.cc:824] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:16.716601 29911 tablet_bootstrap.cc:492] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097: No bootstrap required, opened a new log
I20260809 03:27:16.716677 29911 ts_tablet_manager.cc:1397] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 03:27:16.716723 29912 tablet_bootstrap.cc:492] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946: No bootstrap required, opened a new log
I20260809 03:27:16.716795 29912 ts_tablet_manager.cc:1397] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 03:27:16.718655 29912 raft_consensus.cc:348] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98ffdea7942a41a5ab5287a8da4347e4" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41529 } } peers { permanent_uuid: "fa0e26ecaf214d2b8a020c04b8353946" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39783 } } peers { permanent_uuid: "2a45aa810eee41a5a1e24388b7ffe097" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35221 } }
I20260809 03:27:16.718798 29912 raft_consensus.cc:374] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:16.718839 29912 raft_consensus.cc:729] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa0e26ecaf214d2b8a020c04b8353946, State: Initialized, Role: FOLLOWER
I20260809 03:27:16.719014 29912 consensus_queue.cc:260] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98ffdea7942a41a5ab5287a8da4347e4" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41529 } } peers { permanent_uuid: "fa0e26ecaf214d2b8a020c04b8353946" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39783 } } peers { permanent_uuid: "2a45aa810eee41a5a1e24388b7ffe097" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35221 } }
I20260809 03:27:16.719295 29912 ts_tablet_manager.cc:1428] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260809 03:27:16.719439 29616 heartbeater.cc:503] Master 127.8.5.254:38049 was elected leader, sending a full tablet report...
I20260809 03:27:16.719355 29911 raft_consensus.cc:348] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98ffdea7942a41a5ab5287a8da4347e4" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41529 } } peers { permanent_uuid: "fa0e26ecaf214d2b8a020c04b8353946" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39783 } } peers { permanent_uuid: "2a45aa810eee41a5a1e24388b7ffe097" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35221 } }
I20260809 03:27:16.719514 29911 raft_consensus.cc:374] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:16.719547 29911 raft_consensus.cc:729] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a45aa810eee41a5a1e24388b7ffe097, State: Initialized, Role: FOLLOWER
I20260809 03:27:16.719566 29915 tablet_bootstrap.cc:492] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4: Bootstrap starting.
I20260809 03:27:16.719674 29911 consensus_queue.cc:260] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98ffdea7942a41a5ab5287a8da4347e4" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41529 } } peers { permanent_uuid: "fa0e26ecaf214d2b8a020c04b8353946" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39783 } } peers { permanent_uuid: "2a45aa810eee41a5a1e24388b7ffe097" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35221 } }
I20260809 03:27:16.719929 29911 ts_tablet_manager.cc:1428] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260809 03:27:16.720078 29897 heartbeater.cc:503] Master 127.8.5.254:38049 was elected leader, sending a full tablet report...
I20260809 03:27:16.720302 29915 tablet_bootstrap.cc:654] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:16.720660 29915 log.cc:824] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:16.721336 29915 tablet_bootstrap.cc:492] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4: No bootstrap required, opened a new log
I20260809 03:27:16.721386 29915 ts_tablet_manager.cc:1397] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 03:27:16.723268 29915 raft_consensus.cc:348] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98ffdea7942a41a5ab5287a8da4347e4" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41529 } } peers { permanent_uuid: "fa0e26ecaf214d2b8a020c04b8353946" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39783 } } peers { permanent_uuid: "2a45aa810eee41a5a1e24388b7ffe097" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35221 } }
I20260809 03:27:16.723397 29915 raft_consensus.cc:374] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:16.723419 29915 raft_consensus.cc:729] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98ffdea7942a41a5ab5287a8da4347e4, State: Initialized, Role: FOLLOWER
I20260809 03:27:16.723526 29915 consensus_queue.cc:260] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98ffdea7942a41a5ab5287a8da4347e4" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41529 } } peers { permanent_uuid: "fa0e26ecaf214d2b8a020c04b8353946" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39783 } } peers { permanent_uuid: "2a45aa810eee41a5a1e24388b7ffe097" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35221 } }
I20260809 03:27:16.723730 29915 ts_tablet_manager.cc:1428] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 03:27:16.723810 29758 heartbeater.cc:503] Master 127.8.5.254:38049 was elected leader, sending a full tablet report...
I20260809 03:27:16.804250 29916 raft_consensus.cc:482] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 03:27:16.804380 29916 raft_consensus.cc:504] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98ffdea7942a41a5ab5287a8da4347e4" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41529 } } peers { permanent_uuid: "fa0e26ecaf214d2b8a020c04b8353946" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39783 } } peers { permanent_uuid: "2a45aa810eee41a5a1e24388b7ffe097" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35221 } }
I20260809 03:27:16.804823 29916 leader_election.cc:288] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98ffdea7942a41a5ab5287a8da4347e4 (127.8.5.194:41529), 2a45aa810eee41a5a1e24388b7ffe097 (127.8.5.195:35221)
I20260809 03:27:16.808169 29907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.805092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:47025 (local address 127.8.5.194:41529)
0809 03:27:16.805163 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:16.805165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:16.805177 (+ 12us) server_negotiation.cc:407] Connection header received
0809 03:27:16.805212 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:16.805213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:16.805224 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:16.805288 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:16.805466 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.805974 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.807314 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.807836 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.807904 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.807913 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:16.808061 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 03:27:16.808099 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 03:27:16.808169 29908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.805091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.5.193:50285 (local address 127.8.5.195:35221)
0809 03:27:16.805151 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:16.805154 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:16.805289 (+ 135us) server_negotiation.cc:407] Connection header received
0809 03:27:16.805328 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:16.805329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:16.805338 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:16.805413 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 03:27:16.805586 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.806064 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.807213 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.807788 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.807888 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.807900 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:16.808058 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 03:27:16.808099 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 03:27:16.808169 29618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.805013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.194:41529 (local address 127.8.5.193:47025)
0809 03:27:16.805070 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:16.805083 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:16.805128 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:16.805307 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:16.805308 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:16.805310 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:16.805388 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.805390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.806052 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.806053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.807218 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.807221 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.807934 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.807934 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.807993 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.807996 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 03:27:16.808046 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 03:27:16.808074 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":25}
I20260809 03:27:16.808175 29920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.805048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.195:35221 (local address 127.8.5.193:50285)
0809 03:27:16.805207 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:16.805216 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:16.805279 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:16.805440 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:16.805441 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:16.805443 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 03:27:16.805517 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.805519 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.806140 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.806141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.807121 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:16.807125 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.807898 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.807899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:16.807973 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.807978 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 03:27:16.808030 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 03:27:16.808072 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":92,"threads_started":1}
I20260809 03:27:16.808517 29705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6306b1f38a4b44119bd557aae0232908" candidate_uuid: "fa0e26ecaf214d2b8a020c04b8353946" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98ffdea7942a41a5ab5287a8da4347e4" is_pre_election: true
I20260809 03:27:16.808705 29705 raft_consensus.cc:2454] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa0e26ecaf214d2b8a020c04b8353946 in term 0.
I20260809 03:27:16.808679 29846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6306b1f38a4b44119bd557aae0232908" candidate_uuid: "fa0e26ecaf214d2b8a020c04b8353946" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a45aa810eee41a5a1e24388b7ffe097" is_pre_election: true
I20260809 03:27:16.808801 29846 raft_consensus.cc:2454] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa0e26ecaf214d2b8a020c04b8353946 in term 0.
I20260809 03:27:16.808943 29496 leader_election.cc:302] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98ffdea7942a41a5ab5287a8da4347e4, fa0e26ecaf214d2b8a020c04b8353946; no voters:
I20260809 03:27:16.809073 29916 raft_consensus.cc:2781] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 03:27:16.809170 29916 raft_consensus.cc:482] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 03:27:16.809203 29916 raft_consensus.cc:3037] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [term 0 FOLLOWER]: Advancing to term 1
W20260809 03:27:16.809295 29759 tablet.cc:2369] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 03:27:16.809983 29916 raft_consensus.cc:504] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98ffdea7942a41a5ab5287a8da4347e4" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41529 } } peers { permanent_uuid: "fa0e26ecaf214d2b8a020c04b8353946" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39783 } } peers { permanent_uuid: "2a45aa810eee41a5a1e24388b7ffe097" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35221 } }
I20260809 03:27:16.810138 29916 leader_election.cc:288] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [CANDIDATE]: Term 1 election: Requested vote from peers 98ffdea7942a41a5ab5287a8da4347e4 (127.8.5.194:41529), 2a45aa810eee41a5a1e24388b7ffe097 (127.8.5.195:35221)
I20260809 03:27:16.810281 29705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6306b1f38a4b44119bd557aae0232908" candidate_uuid: "fa0e26ecaf214d2b8a020c04b8353946" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98ffdea7942a41a5ab5287a8da4347e4"
I20260809 03:27:16.810321 29846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6306b1f38a4b44119bd557aae0232908" candidate_uuid: "fa0e26ecaf214d2b8a020c04b8353946" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a45aa810eee41a5a1e24388b7ffe097"
I20260809 03:27:16.810354 29705 raft_consensus.cc:3037] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:16.810410 29846 raft_consensus.cc:3037] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:16.811200 29705 raft_consensus.cc:2454] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa0e26ecaf214d2b8a020c04b8353946 in term 1.
I20260809 03:27:16.811221 29846 raft_consensus.cc:2454] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa0e26ecaf214d2b8a020c04b8353946 in term 1.
I20260809 03:27:16.811379 29496 leader_election.cc:302] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98ffdea7942a41a5ab5287a8da4347e4, fa0e26ecaf214d2b8a020c04b8353946; no voters:
I20260809 03:27:16.811525 29916 raft_consensus.cc:2781] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:16.811702 29916 raft_consensus.cc:686] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [term 1 LEADER]: Becoming Leader. State: Replica: fa0e26ecaf214d2b8a020c04b8353946, State: Running, Role: LEADER
I20260809 03:27:16.811807 29916 consensus_queue.cc:237] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98ffdea7942a41a5ab5287a8da4347e4" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41529 } } peers { permanent_uuid: "fa0e26ecaf214d2b8a020c04b8353946" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39783 } } peers { permanent_uuid: "2a45aa810eee41a5a1e24388b7ffe097" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35221 } }
I20260809 03:27:16.812624 29411 catalog_manager.cc:5495] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa0e26ecaf214d2b8a020c04b8353946 (127.8.5.193). New cstate: current_term: 1 leader_uuid: "fa0e26ecaf214d2b8a020c04b8353946" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98ffdea7942a41a5ab5287a8da4347e4" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa0e26ecaf214d2b8a020c04b8353946" member_type: VOTER last_known_addr { host: "127.8.5.193" port: 39783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a45aa810eee41a5a1e24388b7ffe097" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35221 } health_report { overall_health: UNKNOWN } } }
I20260809 03:27:16.829813 29910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.827383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42994 (local address 127.8.5.193:39783)
0809 03:27:16.827443 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:16.827445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:16.827454 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:27:16.827495 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:16.827496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:16.827519 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:16.827608 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:27:16.827742 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.828230 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.828985 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:16.829197 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:16.829272 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:16.829447 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:27:16.829559 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:27:16.829656 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:16.829676 (+ 20us) server_negotiation.cc:299] Negotiation successful
0809 03:27:16.829695 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 03:27:16.831925 29846 raft_consensus.cc:1261] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097 [term 1 FOLLOWER]: Refusing update from remote peer fa0e26ecaf214d2b8a020c04b8353946: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:27:16.831934 29705 raft_consensus.cc:1261] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4 [term 1 FOLLOWER]: Refusing update from remote peer fa0e26ecaf214d2b8a020c04b8353946: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:27:16.832336 29921 consensus_queue.cc:1035] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a45aa810eee41a5a1e24388b7ffe097" member_type: VOTER last_known_addr { host: "127.8.5.195" port: 35221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:27:16.832490 29916 consensus_queue.cc:1035] T 6306b1f38a4b44119bd557aae0232908 P fa0e26ecaf214d2b8a020c04b8353946 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98ffdea7942a41a5ab5287a8da4347e4" member_type: VOTER last_known_addr { host: "127.8.5.194" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:27:16.834856 29924 mvcc.cc:205] Tried to move back new op lower bound from 7316463766860562432 to 7316463766781841408. Current Snapshot: MvccSnapshot[applied={T|T < 7316463766860562432}]
I20260809 03:27:16.835183 29925 mvcc.cc:205] Tried to move back new op lower bound from 7316463766860562432 to 7316463766781841408. Current Snapshot: MvccSnapshot[applied={T|T < 7316463766860562432}]
I20260809 03:27:16.837360 29411 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46788:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:27:16.837455 29411 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46788:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 03:27:16.838244 29411 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9fb1cd546933455c9beea88e90e54294: Sending DeleteTablet for 3 replicas of tablet 6306b1f38a4b44119bd557aae0232908
I20260809 03:27:16.838587 29684 tablet_service.cc:1514] Processing DeleteTablet for tablet 6306b1f38a4b44119bd557aae0232908 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:27:16 UTC) from {username='slave'} at 127.0.0.1:47786
I20260809 03:27:16.838593 29543 tablet_service.cc:1514] Processing DeleteTablet for tablet 6306b1f38a4b44119bd557aae0232908 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:27:16 UTC) from {username='slave'} at 127.0.0.1:42988
I20260809 03:27:16.838824 29823 tablet_service.cc:1514] Processing DeleteTablet for tablet 6306b1f38a4b44119bd557aae0232908 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 03:27:16 UTC) from {username='slave'} at 127.0.0.1:41684
I20260809 03:27:16.838893 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 29478
I20260809 03:27:16.841341 29936 tablet_replica.cc:330] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097: stopping tablet replica
I20260809 03:27:16.841445 29936 raft_consensus.cc:2229] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:27:16.841599 29936 raft_consensus.cc:2258] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:27:16.841755 29935 tablet_replica.cc:330] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4: stopping tablet replica
I20260809 03:27:16.841861 29935 raft_consensus.cc:2229] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 03:27:16.841957 29935 raft_consensus.cc:2258] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 03:27:16.842363 29935 ts_tablet_manager.cc:1905] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:27:16.842381 29936 ts_tablet_manager.cc:1905] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 03:27:16.844170 29935 ts_tablet_manager.cc:1918] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:27:16.844197 29936 ts_tablet_manager.cc:1918] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 03:27:16.844264 29935 log.cc:1196] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-1/wal/wals/6306b1f38a4b44119bd557aae0232908
I20260809 03:27:16.844265 29936 log.cc:1196] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097: Deleting WAL directory at /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786245797426041-8215-0/minicluster-data/ts-2/wal/wals/6306b1f38a4b44119bd557aae0232908
I20260809 03:27:16.844530 29935 ts_tablet_manager.cc:1939] T 6306b1f38a4b44119bd557aae0232908 P 98ffdea7942a41a5ab5287a8da4347e4: Deleting consensus metadata
I20260809 03:27:16.844547 29936 ts_tablet_manager.cc:1939] T 6306b1f38a4b44119bd557aae0232908 P 2a45aa810eee41a5a1e24388b7ffe097: Deleting consensus metadata
I20260809 03:27:16.844945 29396 catalog_manager.cc:4841] TS 2a45aa810eee41a5a1e24388b7ffe097 (127.8.5.195:35221): tablet 6306b1f38a4b44119bd557aae0232908 (table test-table [id=6ad4e58e9ced421cbb6cff54e141e752]) successfully deleted
I20260809 03:27:16.844957 29398 catalog_manager.cc:4841] TS 98ffdea7942a41a5ab5287a8da4347e4 (127.8.5.194:41529): tablet 6306b1f38a4b44119bd557aae0232908 (table test-table [id=6ad4e58e9ced421cbb6cff54e141e752]) successfully deleted
W20260809 03:27:16.847990 29398 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.5.193:39783 (error 108)
I20260809 03:27:16.848240 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 29619
I20260809 03:27:16.848444 29909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:16.848317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.193:39783 (local address 127.0.0.1:43008)
0809 03:27:16.848369 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:16.848405 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.193:39783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 03:27:16.854372 29398 catalog_manager.cc:4584] TS fa0e26ecaf214d2b8a020c04b8353946 (127.8.5.193:39783): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6306b1f38a4b44119bd557aae0232908: Network error: Client connection negotiation failed: client connection to 127.8.5.193:39783: connect: Connection refused (error 111)
I20260809 03:27:16.854565 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 29761
I20260809 03:27:16.860368 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 29380
2026-08-09T03:27:16Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (740 ms)
[----------] 6 tests from EncryptionPolicyTest (8585 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:16 dist-test-slave-2w3w krb5kdc[29940](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:16 dist-test-slave-2w3w krb5kdc[29940](info): set up 2 sockets
Aug 09 03:27:16 dist-test-slave-2w3w krb5kdc[29940](info): commencing operation
krb5kdc: starting...
W20260809 03:27:18.022037 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:18 dist-test-slave-2w3w krb5kdc[29940](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246038, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 03:27:18.143329 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41047
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41047
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:18.224701 29954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:18.224934 29954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:18.224972 29954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:18.226104 29954 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:18.226171 29954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:18.226193 29954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:18.226215 29954 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:18.226244 29954 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:18.227933 29954 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41047
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:18.228212 29954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:18.228492 29954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:18.233302 29959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:18.233304 29962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:18.233354 29960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:18.233512 29954 server_base.cc:1034] running on GCE node
I20260809 03:27:18.233798 29954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:18.234091 29954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:18.235258 29954 hybrid_clock.cc:648] HybridClock initialized: now 1786246038235243 us; error 28 us; skew 500 ppm
Aug 09 03:27:18 dist-test-slave-2w3w krb5kdc[29940](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246038, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:18.237686 29954 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 03:27:18.238169 29954 webserver.cc:460] Webserver started at http://127.0.0.1:41087/ using document root <none> and password file <none>
I20260809 03:27:18.238399 29954 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:18.238468 29954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:18.238621 29954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:18.239748 29954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "7c3d055cc8da4b89926719d133dfc4b1"
format_stamp: "Formatted at 2026-08-09 03:27:18 on dist-test-slave-2w3w"
server_key: "41d45c5c263bb8b555dc1f123c805218"
server_key_iv: "9ef0f2dbc1101f070bb42729b7d4825e"
server_key_version: "encryptionkey@0"
I20260809 03:27:18.240106 29954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "7c3d055cc8da4b89926719d133dfc4b1"
format_stamp: "Formatted at 2026-08-09 03:27:18 on dist-test-slave-2w3w"
server_key: "41d45c5c263bb8b555dc1f123c805218"
server_key_iv: "9ef0f2dbc1101f070bb42729b7d4825e"
server_key_version: "encryptionkey@0"
I20260809 03:27:18.241434 29954 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 03:27:18.242161 29971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:18.242331 29954 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:27:18.242445 29954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "7c3d055cc8da4b89926719d133dfc4b1"
format_stamp: "Formatted at 2026-08-09 03:27:18 on dist-test-slave-2w3w"
server_key: "41d45c5c263bb8b555dc1f123c805218"
server_key_iv: "9ef0f2dbc1101f070bb42729b7d4825e"
server_key_version: "encryptionkey@0"
I20260809 03:27:18.242518 29954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:18.263702 29954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:18.265543 29954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:18.265714 29954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:18.270016 29954 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41047
I20260809 03:27:18.270052 30027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41047 every 8 connection(s)
I20260809 03:27:18.270422 29954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:18.271399 30028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:18.273578 30028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1: Bootstrap starting.
I20260809 03:27:18.274111 30028 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:18.274343 30028 log.cc:824] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:18.275034 30028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1: No bootstrap required, opened a new log
I20260809 03:27:18.276556 30028 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3d055cc8da4b89926719d133dfc4b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41047 } }
I20260809 03:27:18.276688 30028 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:18.276711 30028 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c3d055cc8da4b89926719d133dfc4b1, State: Initialized, Role: FOLLOWER
I20260809 03:27:18.276855 30028 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3d055cc8da4b89926719d133dfc4b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41047 } }
I20260809 03:27:18.276943 30028 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:18.276968 30028 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:18.277000 30028 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:18.277467 30028 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3d055cc8da4b89926719d133dfc4b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41047 } }
I20260809 03:27:18.277547 30028 leader_election.cc:302] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c3d055cc8da4b89926719d133dfc4b1; no voters:
I20260809 03:27:18.277666 30028 leader_election.cc:288] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:18.277727 30031 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:18.277908 30031 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1 [term 1 LEADER]: Becoming Leader. State: Replica: 7c3d055cc8da4b89926719d133dfc4b1, State: Running, Role: LEADER
I20260809 03:27:18.277918 30028 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:18.278153 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 29954
I20260809 03:27:18.278261 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:18.278487 8215 external_mini_cluster.cc:1428] Setting key 6bfe76760c11929f7ff6353816aa7832
I20260809 03:27:18.278611 30031 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3d055cc8da4b89926719d133dfc4b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41047 } }
I20260809 03:27:18.279294 30033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c3d055cc8da4b89926719d133dfc4b1. Latest consensus state: current_term: 1 leader_uuid: "7c3d055cc8da4b89926719d133dfc4b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3d055cc8da4b89926719d133dfc4b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41047 } } }
I20260809 03:27:18.279415 30033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:18.279618 30032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c3d055cc8da4b89926719d133dfc4b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3d055cc8da4b89926719d133dfc4b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41047 } } }
I20260809 03:27:18.279708 30032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1 [sys.catalog]: This master's current role is: LEADER
W20260809 03:27:18.279992 30048 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:27:18.280048 30048 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:27:18.280135 30049 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:18.280356 30049 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:18.281898 30049 catalog_manager.cc:1347] Generated new cluster ID: 0fbc5c9b2e424db786614b5f625ad662
I20260809 03:27:18.281948 30049 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 03:27:18 dist-test-slave-2w3w krb5kdc[29940](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246038, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 03:27:18.290995 30044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:18.279080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45217 (local address 127.0.0.1:41047)
0809 03:27:18.279866 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:18.279876 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:18.279908 (+ 32us) server_negotiation.cc:407] Connection header received
0809 03:27:18.280022 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:18.280029 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:18.280087 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:18.280886 (+ 799us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:18.281114 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:18.282517 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:18.283603 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:18.284238 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:18.284361 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:18.287254 (+ 2893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:18.287258 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:18.287259 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:18.287271 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:18.289210 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:18.289700 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:18.289703 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:18.289703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:18.289818 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:18.290071 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:18.290072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:18.290073 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:18.290380 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:18.290528 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:18.290657 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 03:27:18.290752 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":92,"threads_started":1}
I20260809 03:27:18.292057 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:18.294870 30049 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:18.295382 30049 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:18.300583 30049 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c3d055cc8da4b89926719d133dfc4b1: Generated new TSK 0
I20260809 03:27:18.300756 30049 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:18.301414 30044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:18.293822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40685 (local address 127.0.0.1:41047)
0809 03:27:18.293866 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:18.293868 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:18.293971 (+ 103us) server_negotiation.cc:407] Connection header received
0809 03:27:18.294082 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:18.294083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:18.294092 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:18.294159 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:18.294890 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:18.295704 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:18.296670 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:18.297001 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:18.297071 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:18.298384 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:18.298385 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:18.298385 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:18.298392 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:18.300060 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:18.300556 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:18.300557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:18.300558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:18.300620 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:18.300901 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:18.300902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:18.300902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:18.301036 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:18.301146 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:18.301252 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 03:27:18.301317 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:27:18.303282 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 29954
W20260809 03:27:18.310392 29938 connection.cc:535] client connection to 127.0.0.1:41047 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41047): Connection reset by peer (error 104)
2026-08-09T03:27:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1442 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:18 dist-test-slave-2w3w krb5kdc[30060](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:18 dist-test-slave-2w3w krb5kdc[30060](info): set up 2 sockets
Aug 09 03:27:18 dist-test-slave-2w3w krb5kdc[30060](info): commencing operation
krb5kdc: starting...
W20260809 03:27:19.376474 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:19 dist-test-slave-2w3w krb5kdc[30060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246039, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 03:27:19.497990 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44361
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44361
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:19.579174 30073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:19.579421 30073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:19.579463 30073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:19.580605 30073 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:19.580670 30073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:19.580696 30073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:19.580727 30073 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:19.580755 30073 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:19.582214 30073 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44361
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:19.582480 30073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:19.582696 30073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:19.587848 30079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:19.587867 30078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:19.587888 30081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:19.588090 30073 server_base.cc:1034] running on GCE node
I20260809 03:27:19.588320 30073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:19.588599 30073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:19.589761 30073 hybrid_clock.cc:648] HybridClock initialized: now 1786246039589757 us; error 37 us; skew 500 ppm
Aug 09 03:27:19 dist-test-slave-2w3w krb5kdc[30060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246039, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:19.596944 30073 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 03:27:19.597415 30073 webserver.cc:460] Webserver started at http://127.0.0.1:43995/ using document root <none> and password file <none>
I20260809 03:27:19.597637 30073 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:19.597702 30073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:19.597847 30073 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:19.598882 30073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "836f1f20dbd34ee39f31d89f2f62985b"
format_stamp: "Formatted at 2026-08-09 03:27:19 on dist-test-slave-2w3w"
server_key: "780b686af64e09da54862e90907d38cf"
server_key_iv: "83614248d99bb5a174bc97d1860231ac"
server_key_version: "encryptionkey@0"
I20260809 03:27:19.599294 30073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "836f1f20dbd34ee39f31d89f2f62985b"
format_stamp: "Formatted at 2026-08-09 03:27:19 on dist-test-slave-2w3w"
server_key: "780b686af64e09da54862e90907d38cf"
server_key_iv: "83614248d99bb5a174bc97d1860231ac"
server_key_version: "encryptionkey@0"
I20260809 03:27:19.600658 30073 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:19.601415 30088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:19.601621 30073 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:19.601720 30073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "836f1f20dbd34ee39f31d89f2f62985b"
format_stamp: "Formatted at 2026-08-09 03:27:19 on dist-test-slave-2w3w"
server_key: "780b686af64e09da54862e90907d38cf"
server_key_iv: "83614248d99bb5a174bc97d1860231ac"
server_key_version: "encryptionkey@0"
I20260809 03:27:19.601804 30073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:19.619561 30073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:19.621533 30073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:19.621695 30073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:19.625957 30073 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44361
I20260809 03:27:19.625995 30143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44361 every 8 connection(s)
I20260809 03:27:19.626355 30073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:19.627578 30144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:19.629887 30144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b: Bootstrap starting.
I20260809 03:27:19.630477 30144 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:19.630781 30144 log.cc:824] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:19.631494 30144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b: No bootstrap required, opened a new log
I20260809 03:27:19.632917 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 30073
I20260809 03:27:19.633145 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:19.633378 8215 external_mini_cluster.cc:1428] Setting key 52214240dc6423f07eac04baba5712e5
I20260809 03:27:19.633491 30144 raft_consensus.cc:348] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "836f1f20dbd34ee39f31d89f2f62985b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44361 } }
I20260809 03:27:19.633664 30144 raft_consensus.cc:374] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:19.633718 30144 raft_consensus.cc:729] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 836f1f20dbd34ee39f31d89f2f62985b, State: Initialized, Role: FOLLOWER
I20260809 03:27:19.633891 30144 consensus_queue.cc:260] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "836f1f20dbd34ee39f31d89f2f62985b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44361 } }
I20260809 03:27:19.633993 30144 raft_consensus.cc:388] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:19.634029 30144 raft_consensus.cc:482] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:19.634081 30144 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:19.634640 30144 raft_consensus.cc:504] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "836f1f20dbd34ee39f31d89f2f62985b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44361 } }
I20260809 03:27:19.634773 30144 leader_election.cc:302] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 836f1f20dbd34ee39f31d89f2f62985b; no voters:
I20260809 03:27:19.634994 30144 leader_election.cc:288] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:19.635015 30149 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:19.635154 30149 raft_consensus.cc:686] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b [term 1 LEADER]: Becoming Leader. State: Replica: 836f1f20dbd34ee39f31d89f2f62985b, State: Running, Role: LEADER
I20260809 03:27:19.635263 30144 sys_catalog.cc:564] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:19.635241 30149 consensus_queue.cc:237] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "836f1f20dbd34ee39f31d89f2f62985b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44361 } }
I20260809 03:27:19.635538 30149 sys_catalog.cc:455] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 836f1f20dbd34ee39f31d89f2f62985b. Latest consensus state: current_term: 1 leader_uuid: "836f1f20dbd34ee39f31d89f2f62985b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "836f1f20dbd34ee39f31d89f2f62985b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44361 } } }
I20260809 03:27:19.635622 30149 sys_catalog.cc:458] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:19.635550 30150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "836f1f20dbd34ee39f31d89f2f62985b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "836f1f20dbd34ee39f31d89f2f62985b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44361 } } }
I20260809 03:27:19.635789 30150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:19.636469 30153 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:19.636974 30153 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:19.638592 30153 catalog_manager.cc:1347] Generated new cluster ID: 5178382cfb3944d387fb4eadede8cef5
I20260809 03:27:19.638648 30153 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:19.639909 30148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:19.633895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58959 (local address 127.0.0.1:44361)
0809 03:27:19.634146 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:19.634156 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:19.634195 (+ 39us) server_negotiation.cc:407] Connection header received
0809 03:27:19.634294 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:19.634299 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:19.634524 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:19.634664 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:19.634921 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:19.636468 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:19.637615 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:19.638191 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:19.638299 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:19.639217 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:19.639220 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:19.639221 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:19.639419 (+ 198us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:19.639455 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:19.639468 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:19.639543 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:19.639673 (+ 130us) server_negotiation.cc:299] Negotiation successful
0809 03:27:19.639697 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":87,"threads_started":1}
I20260809 03:27:19.648136 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:19.648851 30153 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:19.649519 30153 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:19.653463 30148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:19.649675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49233 (local address 127.0.0.1:44361)
0809 03:27:19.649713 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:19.649715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:19.649896 (+ 181us) server_negotiation.cc:407] Connection header received
0809 03:27:19.649946 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:19.649947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:19.649958 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:19.650026 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:19.650144 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:19.650950 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:19.652067 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:19.652383 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:19.652440 (+ 57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:19.653194 (+ 754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:19.653195 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:19.653196 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:19.653201 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:19.653216 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:19.653221 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:19.653277 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:19.653375 (+ 98us) server_negotiation.cc:299] Negotiation successful
0809 03:27:19.653388 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:27:19.659443 30153 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 836f1f20dbd34ee39f31d89f2f62985b: Generated new TSK 0
I20260809 03:27:19.659633 30153 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:19.663908 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 30073
W20260809 03:27:19.670609 30058 connection.cc:535] client connection to 127.0.0.1:44361 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44361): Connection reset by peer (error 104)
2026-08-09T03:27:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1360 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:19 dist-test-slave-2w3w krb5kdc[30177](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:19 dist-test-slave-2w3w krb5kdc[30177](info): set up 2 sockets
Aug 09 03:27:19 dist-test-slave-2w3w krb5kdc[30177](info): commencing operation
krb5kdc: starting...
W20260809 03:27:20.748584 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:20 dist-test-slave-2w3w krb5kdc[30177](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 03:27:20.870101 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43005
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43005
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:20.951392 30190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:20.951591 30190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:20.951614 30190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:20.952754 30190 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:20.952795 30190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:20.952811 30190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:20.952822 30190 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:20.952834 30190 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:20.954375 30190 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43005
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:20.954619 30190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:20.954857 30190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:20.959697 30198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:20.959702 30195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:20.959715 30196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:20.959975 30190 server_base.cc:1034] running on GCE node
I20260809 03:27:20.960175 30190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:20.960402 30190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:20.961545 30190 hybrid_clock.cc:648] HybridClock initialized: now 1786246040961536 us; error 28 us; skew 500 ppm
Aug 09 03:27:20 dist-test-slave-2w3w krb5kdc[30177](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246040, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:20.964000 30190 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 03:27:20.964461 30190 webserver.cc:460] Webserver started at http://127.0.0.1:39929/ using document root <none> and password file <none>
I20260809 03:27:20.964701 30190 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:20.964771 30190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:20.964927 30190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:20.966001 30190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "71db9e0b178c4ed68d27f27aacab7351"
format_stamp: "Formatted at 2026-08-09 03:27:20 on dist-test-slave-2w3w"
server_key: "e92e9202e99085bbf0a1fdc9663aa60d"
server_key_iv: "508b72aded6e71792b365487a6259cc4"
server_key_version: "encryptionkey@0"
I20260809 03:27:20.966356 30190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "71db9e0b178c4ed68d27f27aacab7351"
format_stamp: "Formatted at 2026-08-09 03:27:20 on dist-test-slave-2w3w"
server_key: "e92e9202e99085bbf0a1fdc9663aa60d"
server_key_iv: "508b72aded6e71792b365487a6259cc4"
server_key_version: "encryptionkey@0"
I20260809 03:27:20.967763 30190 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:27:20.968516 30205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:20.968722 30190 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:27:20.968832 30190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "71db9e0b178c4ed68d27f27aacab7351"
format_stamp: "Formatted at 2026-08-09 03:27:20 on dist-test-slave-2w3w"
server_key: "e92e9202e99085bbf0a1fdc9663aa60d"
server_key_iv: "508b72aded6e71792b365487a6259cc4"
server_key_version: "encryptionkey@0"
I20260809 03:27:20.968916 30190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:20.972213 30190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:20.974001 30190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:20.974155 30190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:20.978207 30190 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43005
I20260809 03:27:20.978236 30263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43005 every 8 connection(s)
I20260809 03:27:20.978544 30190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:20.979526 30264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:20.981662 30264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351: Bootstrap starting.
I20260809 03:27:20.982211 30264 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:20.982507 30264 log.cc:824] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:20.983239 30264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351: No bootstrap required, opened a new log
I20260809 03:27:20.984558 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 30190
I20260809 03:27:20.984678 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:20.984907 8215 external_mini_cluster.cc:1428] Setting key c304b828c3baaf91da8bd7e34c108c27
I20260809 03:27:20.985297 30264 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71db9e0b178c4ed68d27f27aacab7351" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43005 } }
I20260809 03:27:20.985509 30264 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:20.985566 30264 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71db9e0b178c4ed68d27f27aacab7351, State: Initialized, Role: FOLLOWER
I20260809 03:27:20.985725 30264 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71db9e0b178c4ed68d27f27aacab7351" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43005 } }
I20260809 03:27:20.985823 30264 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:20.985867 30264 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:20.985915 30264 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:20.986658 30264 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71db9e0b178c4ed68d27f27aacab7351" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43005 } }
I20260809 03:27:20.986764 30264 leader_election.cc:302] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71db9e0b178c4ed68d27f27aacab7351; no voters:
I20260809 03:27:20.986930 30264 leader_election.cc:288] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:20.987089 30269 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:20.987262 30268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:20.985404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35817 (local address 127.0.0.1:43005)
0809 03:27:20.985669 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:20.985678 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:20.985709 (+ 31us) server_negotiation.cc:407] Connection header received
0809 03:27:20.985797 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:20.985802 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:20.985824 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:20.986002 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:20.986681 (+ 679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:20.986684 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:20.986684 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:20.986687 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:20.986740 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:20.986758 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:20.986832 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:20.986944 (+ 112us) server_negotiation.cc:299] Negotiation successful
0809 03:27:20.987008 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":110,"threads_started":1}
I20260809 03:27:20.987351 30264 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:20.987282 30269 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351 [term 1 LEADER]: Becoming Leader. State: Replica: 71db9e0b178c4ed68d27f27aacab7351, State: Running, Role: LEADER
I20260809 03:27:20.987711 30269 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71db9e0b178c4ed68d27f27aacab7351" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43005 } }
I20260809 03:27:20.988096 30269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71db9e0b178c4ed68d27f27aacab7351. Latest consensus state: current_term: 1 leader_uuid: "71db9e0b178c4ed68d27f27aacab7351" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71db9e0b178c4ed68d27f27aacab7351" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43005 } } }
I20260809 03:27:20.988190 30269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:20.988234 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:20.988543 30271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71db9e0b178c4ed68d27f27aacab7351" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71db9e0b178c4ed68d27f27aacab7351" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43005 } } }
I20260809 03:27:20.988636 30271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351 [sys.catalog]: This master's current role is: LEADER
W20260809 03:27:20.989149 30284 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:27:20.989241 30284 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:27:20.989328 30278 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:20.989487 30278 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:20.991056 30268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:20.989856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49735 (local address 127.0.0.1:43005)
0809 03:27:20.989994 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:20.989996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:20.990005 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:27:20.990052 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:20.990053 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:20.990059 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:20.990097 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:20.990760 (+ 663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:20.990762 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:20.990762 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:20.990766 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:20.990780 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:20.990784 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:20.990847 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:20.990985 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 03:27:20.991001 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260809 03:27:20.991334 30278 catalog_manager.cc:1347] Generated new cluster ID: f7db44fc420c4baeb63bc878e9763393
I20260809 03:27:20.991390 30278 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:20.999368 30278 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:20.999528 30278 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:21.004276 30278 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 71db9e0b178c4ed68d27f27aacab7351: Generated new TSK 0
I20260809 03:27:21.004441 30278 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:21.007220 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 30190
2026-08-09T03:27:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1343 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:21 dist-test-slave-2w3w krb5kdc[30295](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:21 dist-test-slave-2w3w krb5kdc[30295](info): set up 2 sockets
Aug 09 03:27:21 dist-test-slave-2w3w krb5kdc[30295](info): commencing operation
krb5kdc: starting...
W20260809 03:27:22.091745 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:22 dist-test-slave-2w3w krb5kdc[30295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 03:27:22.213297 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45793
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45793
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:22.301980 30310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:22.302241 30310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:22.302284 30310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:22.303557 30310 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:22.303633 30310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:22.303661 30310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:22.303685 30310 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:22.303719 30310 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:22.305342 30310 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45793
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:22.305641 30310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:22.305930 30310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:22.311239 30316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:22.311211 30318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:22.311338 30310 server_base.cc:1034] running on GCE node
W20260809 03:27:22.311226 30315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:22.311657 30310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:22.311995 30310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:22.313146 30310 hybrid_clock.cc:648] HybridClock initialized: now 1786246042313128 us; error 35 us; skew 500 ppm
Aug 09 03:27:22 dist-test-slave-2w3w krb5kdc[30295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246042, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:22.315680 30310 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 03:27:22.316180 30310 webserver.cc:460] Webserver started at http://127.0.0.1:42919/ using document root <none> and password file <none>
I20260809 03:27:22.316428 30310 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:22.316505 30310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:22.316684 30310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:22.317850 30310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "d3ccde0bc83b4757a89070c913968305"
format_stamp: "Formatted at 2026-08-09 03:27:22 on dist-test-slave-2w3w"
server_key: "4378d7cc8de0c42e030e19df30bdff20"
server_key_iv: "03b3871fab676cea5ac2481a4e316c5a"
server_key_version: "encryptionkey@0"
I20260809 03:27:22.318244 30310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "d3ccde0bc83b4757a89070c913968305"
format_stamp: "Formatted at 2026-08-09 03:27:22 on dist-test-slave-2w3w"
server_key: "4378d7cc8de0c42e030e19df30bdff20"
server_key_iv: "03b3871fab676cea5ac2481a4e316c5a"
server_key_version: "encryptionkey@0"
I20260809 03:27:22.319752 30310 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:27:22.320698 30326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:22.320914 30310 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:27:22.321030 30310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "d3ccde0bc83b4757a89070c913968305"
format_stamp: "Formatted at 2026-08-09 03:27:22 on dist-test-slave-2w3w"
server_key: "4378d7cc8de0c42e030e19df30bdff20"
server_key_iv: "03b3871fab676cea5ac2481a4e316c5a"
server_key_version: "encryptionkey@0"
I20260809 03:27:22.321107 30310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:22.333941 30310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:22.335922 30310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:22.336082 30310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:22.340343 30310 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45793
I20260809 03:27:22.340380 30385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45793 every 8 connection(s)
I20260809 03:27:22.340762 30310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:22.341717 30387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:22.344036 30387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305: Bootstrap starting.
I20260809 03:27:22.344622 30387 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:22.344872 30387 log.cc:824] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:22.345542 30387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305: No bootstrap required, opened a new log
I20260809 03:27:22.347112 30387 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3ccde0bc83b4757a89070c913968305" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45793 } }
I20260809 03:27:22.347245 30387 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:22.347267 30387 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ccde0bc83b4757a89070c913968305, State: Initialized, Role: FOLLOWER
I20260809 03:27:22.347375 30387 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3ccde0bc83b4757a89070c913968305" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45793 } }
I20260809 03:27:22.347425 30387 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:22.347445 30387 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:22.347472 30387 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:22.347963 30387 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3ccde0bc83b4757a89070c913968305" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45793 } }
I20260809 03:27:22.348044 30387 leader_election.cc:302] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3ccde0bc83b4757a89070c913968305; no voters:
I20260809 03:27:22.348116 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 30310
I20260809 03:27:22.348274 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:22.348264 30387 leader_election.cc:288] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:22.348302 30390 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:22.348464 30390 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305 [term 1 LEADER]: Becoming Leader. State: Replica: d3ccde0bc83b4757a89070c913968305, State: Running, Role: LEADER
I20260809 03:27:22.348486 8215 external_mini_cluster.cc:1428] Setting key 6952fde6a7caee04292433f51a97d50a
I20260809 03:27:22.348562 30387 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:22.348623 30390 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3ccde0bc83b4757a89070c913968305" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45793 } }
I20260809 03:27:22.349537 30394 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3ccde0bc83b4757a89070c913968305. Latest consensus state: current_term: 1 leader_uuid: "d3ccde0bc83b4757a89070c913968305" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3ccde0bc83b4757a89070c913968305" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45793 } } }
I20260809 03:27:22.349632 30394 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:22.350046 30391 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3ccde0bc83b4757a89070c913968305" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3ccde0bc83b4757a89070c913968305" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45793 } } }
I20260809 03:27:22.350143 30391 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305 [sys.catalog]: This master's current role is: LEADER
W20260809 03:27:22.351639 30413 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:27:22.351706 30413 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:27:22.351804 30398 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:22.351981 30398 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:22.353566 30398 catalog_manager.cc:1347] Generated new cluster ID: 8a6a56c5597241509a4b771e34a2af5b
I20260809 03:27:22.353615 30398 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 03:27:22 dist-test-slave-2w3w krb5kdc[30295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 03:27:22.359673 30396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:22.348944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37349 (local address 127.0.0.1:45793)
0809 03:27:22.349114 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:22.349122 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:22.349149 (+ 27us) server_negotiation.cc:407] Connection header received
0809 03:27:22.349269 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:22.349276 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:22.349354 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:22.350253 (+ 899us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:22.350402 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:22.351958 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:22.352928 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:22.353486 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:22.353631 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:22.355948 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:22.355951 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:22.355951 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:22.355962 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:22.358040 (+ 2078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:22.358433 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:22.358437 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:22.358437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:22.358542 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:22.358757 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:22.358758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:22.358758 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:22.359052 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:22.359240 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:22.359309 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 03:27:22.359467 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":89,"threads_started":1}
I20260809 03:27:22.360666 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:22.372496 30398 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:22.373837 30398 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:22.375718 30396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:22.361981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49541 (local address 127.0.0.1:45793)
0809 03:27:22.362018 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:22.362020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:22.367137 (+ 5117us) server_negotiation.cc:407] Connection header received
0809 03:27:22.367208 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:22.367209 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:22.367220 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:22.367264 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:22.367770 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:22.368247 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:22.368961 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:22.369168 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:22.369253 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:22.370395 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:22.370396 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:22.370397 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:22.370403 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:22.371887 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:22.372346 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:22.372347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:22.372347 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:22.372413 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:22.375186 (+ 2773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:22.375187 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:22.375187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:22.375300 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:22.375419 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:22.375526 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 03:27:22.375612 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:27:22.380115 30398 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3ccde0bc83b4757a89070c913968305: Generated new TSK 0
I20260809 03:27:22.380297 30398 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:22.384536 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 30310
2026-08-09T03:27:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1376 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:22 dist-test-slave-2w3w krb5kdc[30423](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:22 dist-test-slave-2w3w krb5kdc[30423](info): set up 2 sockets
Aug 09 03:27:22 dist-test-slave-2w3w krb5kdc[30423](info): commencing operation
krb5kdc: starting...
W20260809 03:27:23.472764 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.068s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:23 dist-test-slave-2w3w krb5kdc[30423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 03:27:23.610000 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39619
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39619
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:23.689989 30436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:23.690188 30436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:23.690212 30436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:23.691397 30436 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:23.691439 30436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:23.691453 30436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:23.691466 30436 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:23.691478 30436 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:23.692975 30436 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39619
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30436
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:23.693222 30436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:23.693454 30436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:23.698334 30442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:23.698321 30441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:23.698321 30445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:23.698606 30436 server_base.cc:1034] running on GCE node
I20260809 03:27:23.698788 30436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:23.699100 30436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:23.700263 30436 hybrid_clock.cc:648] HybridClock initialized: now 1786246043700235 us; error 44 us; skew 500 ppm
Aug 09 03:27:23 dist-test-slave-2w3w krb5kdc[30423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246043, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:23.702658 30436 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 03:27:23.703114 30436 webserver.cc:460] Webserver started at http://127.0.0.1:41777/ using document root <none> and password file <none>
I20260809 03:27:23.703325 30436 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:23.703364 30436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:23.703451 30436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:23.704510 30436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "21a37f8036854fb2a7a2b8236e9844ef"
format_stamp: "Formatted at 2026-08-09 03:27:23 on dist-test-slave-2w3w"
server_key: "e658854421fb4b94ac4fc1d04bf63bed"
server_key_iv: "613c1644466849640a289e704b9d9667"
server_key_version: "encryptionkey@0"
I20260809 03:27:23.704808 30436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "21a37f8036854fb2a7a2b8236e9844ef"
format_stamp: "Formatted at 2026-08-09 03:27:23 on dist-test-slave-2w3w"
server_key: "e658854421fb4b94ac4fc1d04bf63bed"
server_key_iv: "613c1644466849640a289e704b9d9667"
server_key_version: "encryptionkey@0"
I20260809 03:27:23.706045 30436 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:27:23.706668 30452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:23.706830 30436 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:27:23.706928 30436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "21a37f8036854fb2a7a2b8236e9844ef"
format_stamp: "Formatted at 2026-08-09 03:27:23 on dist-test-slave-2w3w"
server_key: "e658854421fb4b94ac4fc1d04bf63bed"
server_key_iv: "613c1644466849640a289e704b9d9667"
server_key_version: "encryptionkey@0"
I20260809 03:27:23.707022 30436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:23.734984 30436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:23.737344 30436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:23.737514 30436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:23.741528 30436 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39619
I20260809 03:27:23.741587 30510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39619 every 8 connection(s)
I20260809 03:27:23.741973 30436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:23.743021 30511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:23.745007 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 30436
I20260809 03:27:23.745177 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:23.745378 8215 external_mini_cluster.cc:1428] Setting key cc72af6e0bd161be8665ebfa61dc11c7
I20260809 03:27:23.745379 30511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef: Bootstrap starting.
I20260809 03:27:23.745996 30511 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:23.746361 30511 log.cc:824] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:23.747107 30511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef: No bootstrap required, opened a new log
I20260809 03:27:23.749068 30511 raft_consensus.cc:348] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21a37f8036854fb2a7a2b8236e9844ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39619 } }
I20260809 03:27:23.749233 30511 raft_consensus.cc:374] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:23.749258 30511 raft_consensus.cc:729] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a37f8036854fb2a7a2b8236e9844ef, State: Initialized, Role: FOLLOWER
I20260809 03:27:23.749387 30511 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21a37f8036854fb2a7a2b8236e9844ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39619 } }
I20260809 03:27:23.749459 30511 raft_consensus.cc:388] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:23.749480 30511 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:23.749543 30511 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:23.750082 30511 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21a37f8036854fb2a7a2b8236e9844ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39619 } }
I20260809 03:27:23.750185 30511 leader_election.cc:302] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21a37f8036854fb2a7a2b8236e9844ef; no voters:
I20260809 03:27:23.750336 30511 leader_election.cc:288] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:23.750409 30516 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:23.750563 30511 sys_catalog.cc:564] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:23.750586 30516 raft_consensus.cc:686] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef [term 1 LEADER]: Becoming Leader. State: Replica: 21a37f8036854fb2a7a2b8236e9844ef, State: Running, Role: LEADER
I20260809 03:27:23.750681 30516 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21a37f8036854fb2a7a2b8236e9844ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39619 } }
I20260809 03:27:23.751197 30518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21a37f8036854fb2a7a2b8236e9844ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21a37f8036854fb2a7a2b8236e9844ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39619 } } }
I20260809 03:27:23.751211 30519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21a37f8036854fb2a7a2b8236e9844ef. Latest consensus state: current_term: 1 leader_uuid: "21a37f8036854fb2a7a2b8236e9844ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21a37f8036854fb2a7a2b8236e9844ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39619 } } }
I20260809 03:27:23.751340 30519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:23.751329 30518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:23.751595 30527 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:23.752097 30527 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:23.752447 30514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:23.745948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38427 (local address 127.0.0.1:39619)
0809 03:27:23.746140 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:23.746150 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:23.746367 (+ 217us) server_negotiation.cc:407] Connection header received
0809 03:27:23.746882 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:23.746888 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:23.746934 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:23.747073 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:23.747335 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:23.748732 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:23.750051 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:23.750687 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:23.750853 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:23.751577 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:23.751581 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:23.751581 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:23.751789 (+ 208us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:23.751832 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:23.751858 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:23.751916 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:23.752101 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 03:27:23.752175 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":88,"threads_started":1}
I20260809 03:27:23.753453 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:23.754911 30527 catalog_manager.cc:1347] Generated new cluster ID: 4d1b61d4bc6648dda62177cf99b4e3ea
I20260809 03:27:23.755069 30527 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:23.761778 30514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:23.754982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51019 (local address 127.0.0.1:39619)
0809 03:27:23.755021 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:23.755023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:23.759144 (+ 4121us) server_negotiation.cc:407] Connection header received
0809 03:27:23.759205 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:23.759206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:23.759217 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:23.759271 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:23.759414 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:23.759889 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:23.760596 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:23.760808 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:23.760911 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:23.761538 (+ 627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:23.761539 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:23.761539 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:23.761544 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:23.761556 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:23.761560 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:23.761602 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:23.761668 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 03:27:23.761687 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:27:23.766569 30527 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:23.767122 30527 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:23.776235 30527 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 21a37f8036854fb2a7a2b8236e9844ef: Generated new TSK 0
I20260809 03:27:23.776402 30527 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:23.785737 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 30436
2026-08-09T03:27:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1400 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:23 dist-test-slave-2w3w krb5kdc[30547](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:23 dist-test-slave-2w3w krb5kdc[30547](info): set up 2 sockets
Aug 09 03:27:23 dist-test-slave-2w3w krb5kdc[30547](info): commencing operation
krb5kdc: starting...
W20260809 03:27:24.869045 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:24 dist-test-slave-2w3w krb5kdc[30547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246044, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 03:27:24.989327 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46085
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:25.074043 30560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:25.074265 30560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:25.074302 30560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:25.075464 30560 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:25.075538 30560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:25.075567 30560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:25.075599 30560 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:25.075621 30560 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:25.077050 30560 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:25.077322 30560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:25.077543 30560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:25.082226 30567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:25.082234 30569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:25.082234 30566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:25.082409 30560 server_base.cc:1034] running on GCE node
I20260809 03:27:25.082646 30560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:25.082928 30560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:25.084131 30560 hybrid_clock.cc:648] HybridClock initialized: now 1786246045084114 us; error 26 us; skew 500 ppm
Aug 09 03:27:25 dist-test-slave-2w3w krb5kdc[30547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246045, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:25.091588 30560 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 03:27:25.092041 30560 webserver.cc:460] Webserver started at http://127.0.0.1:44033/ using document root <none> and password file <none>
I20260809 03:27:25.092278 30560 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:25.092350 30560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:25.092501 30560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:25.093643 30560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "48a33277b83448f8ad203eb73d16ac42"
format_stamp: "Formatted at 2026-08-09 03:27:25 on dist-test-slave-2w3w"
server_key: "ce0a17c78531aad69c59a64d520bea1a"
server_key_iv: "466dc43614c1dac3d3e8a64a4e42b412"
server_key_version: "encryptionkey@0"
I20260809 03:27:25.094033 30560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "48a33277b83448f8ad203eb73d16ac42"
format_stamp: "Formatted at 2026-08-09 03:27:25 on dist-test-slave-2w3w"
server_key: "ce0a17c78531aad69c59a64d520bea1a"
server_key_iv: "466dc43614c1dac3d3e8a64a4e42b412"
server_key_version: "encryptionkey@0"
I20260809 03:27:25.095484 30560 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 03:27:25.096248 30577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:25.096468 30560 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:27:25.096585 30560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "48a33277b83448f8ad203eb73d16ac42"
format_stamp: "Formatted at 2026-08-09 03:27:25 on dist-test-slave-2w3w"
server_key: "ce0a17c78531aad69c59a64d520bea1a"
server_key_iv: "466dc43614c1dac3d3e8a64a4e42b412"
server_key_version: "encryptionkey@0"
I20260809 03:27:25.096659 30560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:25.099984 30560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:25.102241 30560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:25.102396 30560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:25.106781 30560 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46085
I20260809 03:27:25.106837 30631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46085 every 8 connection(s)
I20260809 03:27:25.107180 30560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:25.108165 30632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:25.110311 30632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42: Bootstrap starting.
I20260809 03:27:25.110831 30632 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:25.111142 30632 log.cc:824] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:25.111804 30632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42: No bootstrap required, opened a new log
I20260809 03:27:25.113340 30632 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48a33277b83448f8ad203eb73d16ac42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46085 } }
I20260809 03:27:25.113466 30632 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:25.113488 30632 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a33277b83448f8ad203eb73d16ac42, State: Initialized, Role: FOLLOWER
I20260809 03:27:25.113618 30632 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48a33277b83448f8ad203eb73d16ac42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46085 } }
I20260809 03:27:25.113694 30632 raft_consensus.cc:388] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:25.113716 30632 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:25.113763 30632 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:25.113927 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 30560
I20260809 03:27:25.114053 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:25.114240 8215 external_mini_cluster.cc:1428] Setting key e4203dedaf1b80fcb6738c677821c030
I20260809 03:27:25.114414 30632 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48a33277b83448f8ad203eb73d16ac42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46085 } }
I20260809 03:27:25.114521 30632 leader_election.cc:302] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48a33277b83448f8ad203eb73d16ac42; no voters:
I20260809 03:27:25.114897 30632 leader_election.cc:288] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:25.114938 30637 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:25.115136 30637 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42 [term 1 LEADER]: Becoming Leader. State: Replica: 48a33277b83448f8ad203eb73d16ac42, State: Running, Role: LEADER
I20260809 03:27:25.115239 30632 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:25.115293 30637 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48a33277b83448f8ad203eb73d16ac42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46085 } }
I20260809 03:27:25.115672 30637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48a33277b83448f8ad203eb73d16ac42. Latest consensus state: current_term: 1 leader_uuid: "48a33277b83448f8ad203eb73d16ac42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48a33277b83448f8ad203eb73d16ac42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46085 } } }
I20260809 03:27:25.115793 30637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:25.115687 30638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48a33277b83448f8ad203eb73d16ac42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48a33277b83448f8ad203eb73d16ac42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46085 } } }
I20260809 03:27:25.116107 30638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:25.116248 30642 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:25.116784 30642 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:25.118280 30636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:25.114701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43655 (local address 127.0.0.1:46085)
0809 03:27:25.114926 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:25.114936 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:25.115002 (+ 66us) server_negotiation.cc:407] Connection header received
0809 03:27:25.115125 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:25.115133 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:25.115166 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:25.115594 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:25.117802 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:25.117805 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:25.117806 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:25.117810 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:25.117853 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:25.117870 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:25.117943 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:25.118033 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 03:27:25.118084 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":116,"threads_started":1}
I20260809 03:27:25.118723 30642 catalog_manager.cc:1347] Generated new cluster ID: a77c11df1269464dab1f04544d14a635
I20260809 03:27:25.118816 30642 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:25.119138 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:25.121573 30636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:25.120468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35647 (local address 127.0.0.1:46085)
0809 03:27:25.120508 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:25.120510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:25.120628 (+ 118us) server_negotiation.cc:407] Connection header received
0809 03:27:25.120704 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:25.120704 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:25.120710 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:25.120755 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:25.121336 (+ 581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:25.121337 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:25.121337 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:25.121341 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:25.121355 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:25.121358 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:25.121404 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:25.121467 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 03:27:25.121481 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:27:25.136807 30642 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:25.136969 30642 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:25.145779 30642 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48a33277b83448f8ad203eb73d16ac42: Generated new TSK 0
I20260809 03:27:25.145952 30642 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:25.149915 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 30560
2026-08-09T03:27:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1363 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:25 dist-test-slave-2w3w krb5kdc[30666](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:25 dist-test-slave-2w3w krb5kdc[30666](info): set up 2 sockets
Aug 09 03:27:25 dist-test-slave-2w3w krb5kdc[30666](info): commencing operation
krb5kdc: starting...
W20260809 03:27:26.203311 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.033s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:26 dist-test-slave-2w3w krb5kdc[30666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 03:27:26.321700 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42269
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42269
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:26.403281 30680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:26.403518 30680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:26.403558 30680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:26.404706 30680 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:26.404779 30680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:26.404804 30680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:26.404826 30680 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:26.404884 30680 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:26.406358 30680 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:26.406641 30680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:26.406873 30680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:26.411821 30688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:26.411855 30686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:26.412060 30680 server_base.cc:1034] running on GCE node
W20260809 03:27:26.411871 30685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:26.412328 30680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:26.412604 30680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:26.413763 30680 hybrid_clock.cc:648] HybridClock initialized: now 1786246046413753 us; error 29 us; skew 500 ppm
Aug 09 03:27:26 dist-test-slave-2w3w krb5kdc[30666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246046, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:26.416338 30680 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 03:27:26.416826 30680 webserver.cc:460] Webserver started at http://127.0.0.1:33039/ using document root <none> and password file <none>
I20260809 03:27:26.417084 30680 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:26.417173 30680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:26.417335 30680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:26.418395 30680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "79120a8ca8884213b353609bdd318f99"
format_stamp: "Formatted at 2026-08-09 03:27:26 on dist-test-slave-2w3w"
server_key: "e59093d684e0ad85b907c5110eab0382"
server_key_iv: "cd25a802a9f7e62983b43cba93646242"
server_key_version: "encryptionkey@0"
I20260809 03:27:26.418761 30680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "79120a8ca8884213b353609bdd318f99"
format_stamp: "Formatted at 2026-08-09 03:27:26 on dist-test-slave-2w3w"
server_key: "e59093d684e0ad85b907c5110eab0382"
server_key_iv: "cd25a802a9f7e62983b43cba93646242"
server_key_version: "encryptionkey@0"
I20260809 03:27:26.420235 30680 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:26.421018 30695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:26.421203 30680 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:27:26.421311 30680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "79120a8ca8884213b353609bdd318f99"
format_stamp: "Formatted at 2026-08-09 03:27:26 on dist-test-slave-2w3w"
server_key: "e59093d684e0ad85b907c5110eab0382"
server_key_iv: "cd25a802a9f7e62983b43cba93646242"
server_key_version: "encryptionkey@0"
I20260809 03:27:26.421393 30680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:26.436218 30680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:26.438177 30680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:26.438347 30680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:26.442761 30680 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42269
I20260809 03:27:26.442812 30753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42269 every 8 connection(s)
I20260809 03:27:26.443183 30680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:26.444157 30754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:26.446381 30754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99: Bootstrap starting.
I20260809 03:27:26.446673 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 30680
I20260809 03:27:26.446834 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:26.447088 8215 external_mini_cluster.cc:1428] Setting key cfbab9fcaeca87af932def3b248129a8
I20260809 03:27:26.447185 30754 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:26.447526 30754 log.cc:824] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:26.448349 30754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99: No bootstrap required, opened a new log
I20260809 03:27:26.450729 30754 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79120a8ca8884213b353609bdd318f99" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42269 } }
I20260809 03:27:26.450920 30754 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:26.450992 30754 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79120a8ca8884213b353609bdd318f99, State: Initialized, Role: FOLLOWER
I20260809 03:27:26.451125 30754 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79120a8ca8884213b353609bdd318f99" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42269 } }
I20260809 03:27:26.451231 30754 raft_consensus.cc:388] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:26.451275 30754 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:26.451325 30754 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:26.451924 30754 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79120a8ca8884213b353609bdd318f99" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42269 } }
I20260809 03:27:26.452031 30754 leader_election.cc:302] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79120a8ca8884213b353609bdd318f99; no voters:
I20260809 03:27:26.452193 30754 leader_election.cc:288] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:26.452265 30761 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:26.452446 30754 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:26.452497 30761 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99 [term 1 LEADER]: Becoming Leader. State: Replica: 79120a8ca8884213b353609bdd318f99, State: Running, Role: LEADER
I20260809 03:27:26.452694 30761 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79120a8ca8884213b353609bdd318f99" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42269 } }
I20260809 03:27:26.453097 30762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79120a8ca8884213b353609bdd318f99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79120a8ca8884213b353609bdd318f99" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42269 } } }
I20260809 03:27:26.453197 30762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:26.453424 30770 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:26.453989 30770 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:26.453096 30763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79120a8ca8884213b353609bdd318f99. Latest consensus state: current_term: 1 leader_uuid: "79120a8ca8884213b353609bdd318f99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79120a8ca8884213b353609bdd318f99" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42269 } } }
I20260809 03:27:26.454624 30763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99 [sys.catalog]: This master's current role is: LEADER
Aug 09 03:27:26 dist-test-slave-2w3w krb5kdc[30666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 03:27:26.455705 30770 catalog_manager.cc:1347] Generated new cluster ID: a9f79b3fa480484383e02461a8203e96
I20260809 03:27:26.455761 30770 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:26.459004 30759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:26.447649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:57753 (local address 127.0.0.1:42269)
0809 03:27:26.447851 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:26.447859 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:26.447885 (+ 26us) server_negotiation.cc:407] Connection header received
0809 03:27:26.448539 (+ 654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:26.448548 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:26.448610 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:26.448757 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:26.449418 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:26.450865 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:26.451783 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:26.452443 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:26.452569 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:26.455580 (+ 3011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:26.455584 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:26.455584 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:26.455595 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:26.457402 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:26.457802 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:26.457805 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:26.457805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:26.457905 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:26.458137 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:26.458138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:26.458139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:26.458373 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:26.458551 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:26.458636 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 03:27:26.458733 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":101,"threads_started":1}
I20260809 03:27:26.460210 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:26.469048 30759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:26.461527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:42557 (local address 127.0.0.1:42269)
0809 03:27:26.461564 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:26.461566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:26.463128 (+ 1562us) server_negotiation.cc:407] Connection header received
0809 03:27:26.463190 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:26.463191 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:26.463202 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:26.463276 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:26.463777 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:26.464277 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:26.464997 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:26.465206 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:26.465288 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:26.466434 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:26.466436 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:26.466436 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:26.466443 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:26.467897 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:26.468256 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:26.468257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:26.468257 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:26.468310 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:26.468538 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:26.468539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:26.468540 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:26.468651 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:26.468760 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:26.468872 (+ 112us) server_negotiation.cc:299] Negotiation successful
0809 03:27:26.468935 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:27:26.469548 30770 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:26.470191 30770 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:26.477733 30770 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79120a8ca8884213b353609bdd318f99: Generated new TSK 0
I20260809 03:27:26.477905 30770 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:26.481109 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 30680
W20260809 03:27:26.487892 30664 connection.cc:535] client connection to 127.0.0.1:42269 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42269): Connection reset by peer (error 104)
2026-08-09T03:27:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1331 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:26 dist-test-slave-2w3w krb5kdc[30787](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:26 dist-test-slave-2w3w krb5kdc[30787](info): set up 2 sockets
Aug 09 03:27:26 dist-test-slave-2w3w krb5kdc[30787](info): commencing operation
krb5kdc: starting...
W20260809 03:27:27.564373 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:27 dist-test-slave-2w3w krb5kdc[30787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 03:27:27.685868 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35049
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35049
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:27.767395 30801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:27.767582 30801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:27.767604 30801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:27.768743 30801 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:27.768785 30801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:27.768800 30801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:27.768818 30801 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:27.768877 30801 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:27.770339 30801 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35049
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:27.770581 30801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:27.770838 30801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:27.775692 30808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:27.775727 30807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:27.775692 30810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:27.776016 30801 server_base.cc:1034] running on GCE node
I20260809 03:27:27.776264 30801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:27.776547 30801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:27.777729 30801 hybrid_clock.cc:648] HybridClock initialized: now 1786246047777710 us; error 28 us; skew 500 ppm
Aug 09 03:27:27 dist-test-slave-2w3w krb5kdc[30787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246047, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:27.780296 30801 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 03:27:27.780769 30801 webserver.cc:460] Webserver started at http://127.0.0.1:37407/ using document root <none> and password file <none>
I20260809 03:27:27.781023 30801 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:27.781097 30801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:27.781246 30801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:27.782272 30801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "35377689e42544a7980a3da72849617e"
format_stamp: "Formatted at 2026-08-09 03:27:27 on dist-test-slave-2w3w"
server_key: "91bf58aa8933cd883ec791899a39007b"
server_key_iv: "e35018313545af2ac185de103754e3fb"
server_key_version: "encryptionkey@0"
I20260809 03:27:27.782627 30801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "35377689e42544a7980a3da72849617e"
format_stamp: "Formatted at 2026-08-09 03:27:27 on dist-test-slave-2w3w"
server_key: "91bf58aa8933cd883ec791899a39007b"
server_key_iv: "e35018313545af2ac185de103754e3fb"
server_key_version: "encryptionkey@0"
I20260809 03:27:27.784065 30801 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:27:27.784791 30817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:27.784965 30801 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:27.785071 30801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "35377689e42544a7980a3da72849617e"
format_stamp: "Formatted at 2026-08-09 03:27:27 on dist-test-slave-2w3w"
server_key: "91bf58aa8933cd883ec791899a39007b"
server_key_iv: "e35018313545af2ac185de103754e3fb"
server_key_version: "encryptionkey@0"
I20260809 03:27:27.785145 30801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:27.817960 30801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:27.820402 30801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:27.820571 30801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:27.825011 30801 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35049
I20260809 03:27:27.825139 30873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35049 every 8 connection(s)
I20260809 03:27:27.825453 30801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:27.826462 30874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:27.828775 30874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e: Bootstrap starting.
I20260809 03:27:27.829413 30874 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:27.829650 30874 log.cc:824] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:27.830356 30874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e: No bootstrap required, opened a new log
I20260809 03:27:27.831297 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 30801
I20260809 03:27:27.831423 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:27.831626 8215 external_mini_cluster.cc:1428] Setting key bb957280a319e7a214edbba3b0132a51
I20260809 03:27:27.832516 30874 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35377689e42544a7980a3da72849617e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35049 } }
I20260809 03:27:27.832701 30874 raft_consensus.cc:374] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:27.832741 30874 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35377689e42544a7980a3da72849617e, State: Initialized, Role: FOLLOWER
I20260809 03:27:27.832870 30874 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35377689e42544a7980a3da72849617e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35049 } }
I20260809 03:27:27.832962 30874 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:27.833034 30874 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:27.833092 30874 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:27.833660 30874 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35377689e42544a7980a3da72849617e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35049 } }
I20260809 03:27:27.833757 30874 leader_election.cc:302] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35377689e42544a7980a3da72849617e; no voters:
I20260809 03:27:27.833933 30874 leader_election.cc:288] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:27.833964 30880 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:27.834069 30880 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e [term 1 LEADER]: Becoming Leader. State: Replica: 35377689e42544a7980a3da72849617e, State: Running, Role: LEADER
I20260809 03:27:27.834209 30874 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:27.834219 30880 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35377689e42544a7980a3da72849617e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35049 } }
I20260809 03:27:27.834847 30882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35377689e42544a7980a3da72849617e. Latest consensus state: current_term: 1 leader_uuid: "35377689e42544a7980a3da72849617e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35377689e42544a7980a3da72849617e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35049 } } }
I20260809 03:27:27.835204 30881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "35377689e42544a7980a3da72849617e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35377689e42544a7980a3da72849617e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35049 } } }
I20260809 03:27:27.835278 30881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:27.835508 30882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:27.835688 30892 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:27.836191 30892 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:27.838162 30892 catalog_manager.cc:1347] Generated new cluster ID: df49028e178c4b6aaa9c5feb53de5e1b
I20260809 03:27:27.838217 30892 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:27.838217 30879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:27.832165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:56251 (local address 127.0.0.1:35049)
0809 03:27:27.832382 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:27.832392 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:27.832614 (+ 222us) server_negotiation.cc:407] Connection header received
0809 03:27:27.832771 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:27.832778 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:27.832840 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:27.833011 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:27.833251 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:27.834799 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:27.835982 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:27.836565 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:27.836682 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:27.837442 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:27.837446 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:27.837446 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:27.837663 (+ 217us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:27.837702 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:27.837717 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:27.837809 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:27.837944 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 03:27:27.837976 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":92,"threads_started":1}
I20260809 03:27:27.839226 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:27.844641 30879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:27.840875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:44787 (local address 127.0.0.1:35049)
0809 03:27:27.840907 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:27.840909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:27.841184 (+ 275us) server_negotiation.cc:407] Connection header received
0809 03:27:27.841248 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:27.841248 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:27.841269 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:27.841329 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:27.841482 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:27.842194 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:27.843306 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:27.843623 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:27.843691 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:27.844377 (+ 686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:27.844378 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:27.844378 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:27.844383 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:27.844397 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:27.844401 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:27.844456 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:27.844558 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 03:27:27.844571 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260809 03:27:27.849538 30892 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:27.850072 30892 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:27.859910 30892 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 35377689e42544a7980a3da72849617e: Generated new TSK 0
I20260809 03:27:27.860100 30892 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:27.867455 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 30801
W20260809 03:27:27.874243 30785 connection.cc:535] client connection to 127.0.0.1:35049 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35049): Connection reset by peer (error 104)
2026-08-09T03:27:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1386 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:27 dist-test-slave-2w3w krb5kdc[30908](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:27 dist-test-slave-2w3w krb5kdc[30908](info): set up 2 sockets
Aug 09 03:27:27 dist-test-slave-2w3w krb5kdc[30908](info): commencing operation
krb5kdc: starting...
W20260809 03:27:28.940773 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:29 dist-test-slave-2w3w krb5kdc[30908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 03:27:29.061789 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35519
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35519
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:29.142336 30922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:29.142566 30922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:29.142601 30922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:29.143793 30922 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:29.143864 30922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:29.143888 30922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:29.143908 30922 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:29.143937 30922 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:29.145386 30922 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35519
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:29.145653 30922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:29.145879 30922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:29.150602 30927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:29.150614 30930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:29.150614 30928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:29.150775 30922 server_base.cc:1034] running on GCE node
I20260809 03:27:29.151109 30922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:29.151393 30922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:29.152534 30922 hybrid_clock.cc:648] HybridClock initialized: now 1786246049152525 us; error 31 us; skew 500 ppm
Aug 09 03:27:29 dist-test-slave-2w3w krb5kdc[30908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246049, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:29.155072 30922 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 03:27:29.155449 30922 webserver.cc:460] Webserver started at http://127.0.0.1:40137/ using document root <none> and password file <none>
I20260809 03:27:29.155643 30922 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:29.155683 30922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:29.155767 30922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:29.156751 30922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "96eaa8d8eb704df6a322aee23ae4d3d8"
format_stamp: "Formatted at 2026-08-09 03:27:29 on dist-test-slave-2w3w"
server_key: "022c70aa3fd052b7dff0b217a3c805b1"
server_key_iv: "363b2f0bad2ed4931c33ac463bf6c458"
server_key_version: "encryptionkey@0"
I20260809 03:27:29.157051 30922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "96eaa8d8eb704df6a322aee23ae4d3d8"
format_stamp: "Formatted at 2026-08-09 03:27:29 on dist-test-slave-2w3w"
server_key: "022c70aa3fd052b7dff0b217a3c805b1"
server_key_iv: "363b2f0bad2ed4931c33ac463bf6c458"
server_key_version: "encryptionkey@0"
I20260809 03:27:29.158335 30922 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:27:29.159123 30938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:29.159305 30922 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:27:29.159410 30922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "96eaa8d8eb704df6a322aee23ae4d3d8"
format_stamp: "Formatted at 2026-08-09 03:27:29 on dist-test-slave-2w3w"
server_key: "022c70aa3fd052b7dff0b217a3c805b1"
server_key_iv: "363b2f0bad2ed4931c33ac463bf6c458"
server_key_version: "encryptionkey@0"
I20260809 03:27:29.159497 30922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:29.162802 30922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:29.165163 30922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:29.165328 30922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:29.169575 30922 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35519
I20260809 03:27:29.169606 30996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35519 every 8 connection(s)
I20260809 03:27:29.169939 30922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:29.171023 30997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:29.173314 30997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8: Bootstrap starting.
I20260809 03:27:29.173898 30997 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:29.174198 30997 log.cc:824] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:29.175077 30997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8: No bootstrap required, opened a new log
I20260809 03:27:29.176512 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 30922
I20260809 03:27:29.176663 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:29.176883 8215 external_mini_cluster.cc:1428] Setting key 28065a8015fa789df5da983d89e22f9b
I20260809 03:27:29.176824 30997 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96eaa8d8eb704df6a322aee23ae4d3d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35519 } }
I20260809 03:27:29.176970 30997 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:29.177017 30997 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa8d8eb704df6a322aee23ae4d3d8, State: Initialized, Role: FOLLOWER
I20260809 03:27:29.177172 30997 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96eaa8d8eb704df6a322aee23ae4d3d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35519 } }
I20260809 03:27:29.177234 30997 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:29.177284 30997 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:29.177337 30997 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:29.178300 30997 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96eaa8d8eb704df6a322aee23ae4d3d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35519 } }
I20260809 03:27:29.178424 30997 leader_election.cc:302] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96eaa8d8eb704df6a322aee23ae4d3d8; no voters:
I20260809 03:27:29.178592 30997 leader_election.cc:288] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:29.178627 31002 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:29.178738 31002 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa8d8eb704df6a322aee23ae4d3d8, State: Running, Role: LEADER
I20260809 03:27:29.178875 30997 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:29.178892 31002 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96eaa8d8eb704df6a322aee23ae4d3d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35519 } }
I20260809 03:27:29.179426 31004 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96eaa8d8eb704df6a322aee23ae4d3d8. Latest consensus state: current_term: 1 leader_uuid: "96eaa8d8eb704df6a322aee23ae4d3d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96eaa8d8eb704df6a322aee23ae4d3d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35519 } } }
I20260809 03:27:29.179502 31001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:29.177431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:44877 (local address 127.0.0.1:35519)
0809 03:27:29.177638 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:29.177648 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:29.177682 (+ 34us) server_negotiation.cc:407] Connection header received
0809 03:27:29.177790 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:29.177795 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:29.177820 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:29.177955 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:29.178781 (+ 826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:29.178784 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:29.178785 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:29.178790 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:29.178834 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:29.178848 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:29.179130 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:29.179160 (+ 30us) server_negotiation.cc:299] Negotiation successful
0809 03:27:29.179202 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":97,"threads_started":1}
I20260809 03:27:29.179430 31003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96eaa8d8eb704df6a322aee23ae4d3d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96eaa8d8eb704df6a322aee23ae4d3d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35519 } } }
I20260809 03:27:29.179549 31004 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:29.179575 31003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:29.179790 31011 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:29.180307 31011 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:29.180727 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:29.183248 31011 catalog_manager.cc:1347] Generated new cluster ID: edbd4154ac444cf19cca562169a82f94
I20260809 03:27:29.183302 31011 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:29.183542 31001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:29.182152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:38859 (local address 127.0.0.1:35519)
0809 03:27:29.182186 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:29.182187 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:29.182496 (+ 309us) server_negotiation.cc:407] Connection header received
0809 03:27:29.182561 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:29.182562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:29.182567 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:29.182618 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:29.183305 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:29.183306 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:29.183307 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:29.183312 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:29.183329 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:29.183333 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:29.183397 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:29.183469 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 03:27:29.183484 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 03:27:29.201354 31011 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:29.201521 31011 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:29.209438 31011 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96eaa8d8eb704df6a322aee23ae4d3d8: Generated new TSK 0
I20260809 03:27:29.209663 31011 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:29.221300 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 30922
2026-08-09T03:27:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1353 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:29 dist-test-slave-2w3w krb5kdc[31030](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:29 dist-test-slave-2w3w krb5kdc[31030](info): set up 2 sockets
Aug 09 03:27:29 dist-test-slave-2w3w krb5kdc[31030](info): commencing operation
krb5kdc: starting...
W20260809 03:27:30.292202 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:30 dist-test-slave-2w3w krb5kdc[31030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 03:27:30.410068 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40055
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40055
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:30.490818 31045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:30.491084 31045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:30.491113 31045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:30.492234 31045 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:30.492276 31045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:30.492290 31045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:30.492333 31045 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:30.492360 31045 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:30.493762 31045 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40055
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31045
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:30.493999 31045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:30.494218 31045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:30.499063 31050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:30.499112 31054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:30.499040 31052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:30.499060 31045 server_base.cc:1034] running on GCE node
I20260809 03:27:30.499594 31045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:30.499856 31045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:30.501013 31045 hybrid_clock.cc:648] HybridClock initialized: now 1786246050500997 us; error 34 us; skew 500 ppm
Aug 09 03:27:30 dist-test-slave-2w3w krb5kdc[31030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246050, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:30.506858 31045 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 03:27:30.507337 31045 webserver.cc:460] Webserver started at http://127.0.0.1:42737/ using document root <none> and password file <none>
I20260809 03:27:30.507563 31045 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:30.507632 31045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:30.507782 31045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:30.508819 31045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "8d5b364355ba47ef9dbd4d511c2338dc"
format_stamp: "Formatted at 2026-08-09 03:27:30 on dist-test-slave-2w3w"
server_key: "0169b6f4107ccd0c75bff41100a12ff5"
server_key_iv: "bdcec6ae9024c8055ad4628858686983"
server_key_version: "encryptionkey@0"
I20260809 03:27:30.509171 31045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "8d5b364355ba47ef9dbd4d511c2338dc"
format_stamp: "Formatted at 2026-08-09 03:27:30 on dist-test-slave-2w3w"
server_key: "0169b6f4107ccd0c75bff41100a12ff5"
server_key_iv: "bdcec6ae9024c8055ad4628858686983"
server_key_version: "encryptionkey@0"
I20260809 03:27:30.510457 31045 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:27:30.511207 31061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:30.511399 31045 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:27:30.511504 31045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "8d5b364355ba47ef9dbd4d511c2338dc"
format_stamp: "Formatted at 2026-08-09 03:27:30 on dist-test-slave-2w3w"
server_key: "0169b6f4107ccd0c75bff41100a12ff5"
server_key_iv: "bdcec6ae9024c8055ad4628858686983"
server_key_version: "encryptionkey@0"
I20260809 03:27:30.511577 31045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:30.526101 31045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:30.527848 31045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:30.528003 31045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:30.532303 31045 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40055
I20260809 03:27:30.532335 31115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40055 every 8 connection(s)
I20260809 03:27:30.532666 31045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:30.533584 31116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:30.535117 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 31045
I20260809 03:27:30.535233 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:30.535415 8215 external_mini_cluster.cc:1428] Setting key 2b439cde3a56e7265f95de3b2a8b05df
I20260809 03:27:30.536199 31116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc: Bootstrap starting.
I20260809 03:27:30.536768 31116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:30.537089 31116 log.cc:824] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:30.537880 31116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc: No bootstrap required, opened a new log
I20260809 03:27:30.540198 31116 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d5b364355ba47ef9dbd4d511c2338dc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40055 } }
I20260809 03:27:30.540371 31116 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:30.540414 31116 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d5b364355ba47ef9dbd4d511c2338dc, State: Initialized, Role: FOLLOWER
I20260809 03:27:30.540567 31116 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d5b364355ba47ef9dbd4d511c2338dc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40055 } }
I20260809 03:27:30.540668 31116 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:30.540693 31116 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:30.540767 31116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:30.541400 31116 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d5b364355ba47ef9dbd4d511c2338dc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40055 } }
I20260809 03:27:30.541488 31116 leader_election.cc:302] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d5b364355ba47ef9dbd4d511c2338dc; no voters:
I20260809 03:27:30.541687 31116 leader_election.cc:288] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:30.541745 31122 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:30.541900 31122 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc [term 1 LEADER]: Becoming Leader. State: Replica: 8d5b364355ba47ef9dbd4d511c2338dc, State: Running, Role: LEADER
I20260809 03:27:30.541973 31116 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:30.542065 31122 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d5b364355ba47ef9dbd4d511c2338dc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40055 } }
I20260809 03:27:30.542502 31122 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d5b364355ba47ef9dbd4d511c2338dc. Latest consensus state: current_term: 1 leader_uuid: "8d5b364355ba47ef9dbd4d511c2338dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d5b364355ba47ef9dbd4d511c2338dc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40055 } } }
I20260809 03:27:30.542599 31122 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc [sys.catalog]: This master's current role is: LEADER
Aug 09 03:27:30 dist-test-slave-2w3w krb5kdc[31030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 03:27:30.542790 31124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d5b364355ba47ef9dbd4d511c2338dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d5b364355ba47ef9dbd4d511c2338dc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40055 } } }
I20260809 03:27:30.542851 31124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:30.543146 31131 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:30.543689 31131 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:30.545728 31131 catalog_manager.cc:1347] Generated new cluster ID: bb2b6a050d6a4d99a42396b194e826e0
I20260809 03:27:30.545785 31131 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:30.547302 31119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:30.535907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:42445 (local address 127.0.0.1:40055)
0809 03:27:30.536094 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:30.536103 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:30.536137 (+ 34us) server_negotiation.cc:407] Connection header received
0809 03:27:30.536593 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:30.536599 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:30.536646 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:30.536788 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:30.537564 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:30.539022 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:30.539748 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:30.540382 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:30.540493 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:30.543513 (+ 3020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:30.543516 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:30.543516 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:30.543527 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:30.545666 (+ 2139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:30.546103 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:30.546106 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:30.546106 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:30.546202 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:30.546446 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:30.546447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:30.546447 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:30.546678 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:30.546878 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:30.546985 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 03:27:30.547088 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":85,"threads_started":1}
I20260809 03:27:30.548305 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:30.555714 31119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:30.549653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:55439 (local address 127.0.0.1:40055)
0809 03:27:30.549688 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:30.549689 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:30.549816 (+ 127us) server_negotiation.cc:407] Connection header received
0809 03:27:30.549885 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:30.549886 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:30.549896 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:30.549950 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:30.550453 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:30.550939 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:30.551684 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:30.551922 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:30.552005 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:30.553129 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:30.553131 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:30.553131 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:30.553138 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:30.554511 (+ 1373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:30.554893 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:30.554894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:30.554894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:30.554949 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:30.555203 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:30.555204 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:30.555204 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:30.555311 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:30.555420 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:30.555549 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 03:27:30.555611 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":8,"server-negotiator.queue_time_us":18}
I20260809 03:27:30.565696 31131 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:30.566437 31131 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:30.574774 31131 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d5b364355ba47ef9dbd4d511c2338dc: Generated new TSK 0
I20260809 03:27:30.574973 31131 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:30.577610 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 31045
W20260809 03:27:30.583765 31028 connection.cc:535] client connection to 127.0.0.1:40055 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40055): Connection reset by peer (error 104)
2026-08-09T03:27:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1355 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:30 dist-test-slave-2w3w krb5kdc[31149](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:30 dist-test-slave-2w3w krb5kdc[31149](info): set up 2 sockets
Aug 09 03:27:30 dist-test-slave-2w3w krb5kdc[31149](info): commencing operation
krb5kdc: starting...
W20260809 03:27:31.656462 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:31 dist-test-slave-2w3w krb5kdc[31149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 03:27:31.778385 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35873
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35873
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:31.859860 31164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:31.860092 31164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:31.860131 31164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:31.861270 31164 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:31.861356 31164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:31.861382 31164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:31.861409 31164 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:31.861439 31164 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:31.862890 31164 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35873
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:31.863173 31164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:31.863407 31164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:31.868153 31172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:31.868168 31170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:31.868168 31169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:31.868443 31164 server_base.cc:1034] running on GCE node
I20260809 03:27:31.868695 31164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:31.868995 31164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:31.870138 31164 hybrid_clock.cc:648] HybridClock initialized: now 1786246051870118 us; error 44 us; skew 500 ppm
Aug 09 03:27:31 dist-test-slave-2w3w krb5kdc[31149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246051, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:31.872726 31164 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 03:27:31.873202 31164 webserver.cc:460] Webserver started at http://127.0.0.1:41707/ using document root <none> and password file <none>
I20260809 03:27:31.873445 31164 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:31.873490 31164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:31.873656 31164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:31.874693 31164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "7ded3ad1864f450cb73c9d84ecc46c85"
format_stamp: "Formatted at 2026-08-09 03:27:31 on dist-test-slave-2w3w"
server_key: "d9b090b54a0c9f1c48536d5576ec4abc"
server_key_iv: "c0e91ad2423ddfcd61be646acb884b16"
server_key_version: "encryptionkey@0"
I20260809 03:27:31.875093 31164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "7ded3ad1864f450cb73c9d84ecc46c85"
format_stamp: "Formatted at 2026-08-09 03:27:31 on dist-test-slave-2w3w"
server_key: "d9b090b54a0c9f1c48536d5576ec4abc"
server_key_iv: "c0e91ad2423ddfcd61be646acb884b16"
server_key_version: "encryptionkey@0"
I20260809 03:27:31.876421 31164 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 03:27:31.877136 31179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:31.877346 31164 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:27:31.877434 31164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "7ded3ad1864f450cb73c9d84ecc46c85"
format_stamp: "Formatted at 2026-08-09 03:27:31 on dist-test-slave-2w3w"
server_key: "d9b090b54a0c9f1c48536d5576ec4abc"
server_key_iv: "c0e91ad2423ddfcd61be646acb884b16"
server_key_version: "encryptionkey@0"
I20260809 03:27:31.877509 31164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:31.896775 31164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:31.898702 31164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:31.898809 31164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:31.903244 31164 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35873
I20260809 03:27:31.903360 31237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35873 every 8 connection(s)
I20260809 03:27:31.903673 31164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:31.904572 31238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:31.907063 31238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85: Bootstrap starting.
I20260809 03:27:31.907711 31238 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:31.908020 31238 log.cc:824] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:31.908737 31238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85: No bootstrap required, opened a new log
I20260809 03:27:31.910522 31238 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ded3ad1864f450cb73c9d84ecc46c85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35873 } }
I20260809 03:27:31.910667 31238 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:31.910692 31238 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ded3ad1864f450cb73c9d84ecc46c85, State: Initialized, Role: FOLLOWER
I20260809 03:27:31.910866 31238 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ded3ad1864f450cb73c9d84ecc46c85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35873 } }
I20260809 03:27:31.910933 31238 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:31.911003 31238 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:31.911060 31238 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:31.911656 31238 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ded3ad1864f450cb73c9d84ecc46c85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35873 } }
I20260809 03:27:31.911777 31238 leader_election.cc:302] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ded3ad1864f450cb73c9d84ecc46c85; no voters:
I20260809 03:27:31.911973 31238 leader_election.cc:288] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:31.912009 31241 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:31.912182 31241 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85 [term 1 LEADER]: Becoming Leader. State: Replica: 7ded3ad1864f450cb73c9d84ecc46c85, State: Running, Role: LEADER
I20260809 03:27:31.912261 31238 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:31.912348 31241 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ded3ad1864f450cb73c9d84ecc46c85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35873 } }
I20260809 03:27:31.912703 31243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ded3ad1864f450cb73c9d84ecc46c85. Latest consensus state: current_term: 1 leader_uuid: "7ded3ad1864f450cb73c9d84ecc46c85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ded3ad1864f450cb73c9d84ecc46c85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35873 } } }
I20260809 03:27:31.912827 31242 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ded3ad1864f450cb73c9d84ecc46c85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ded3ad1864f450cb73c9d84ecc46c85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35873 } } }
I20260809 03:27:31.912935 31242 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:31.912835 31243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:31.913168 31250 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:31.913458 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 31164
I20260809 03:27:31.913585 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:31.913735 31250 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:31.913789 8215 external_mini_cluster.cc:1428] Setting key f39aba9f6026b5366279477f5cc66096
I20260809 03:27:31.915418 31250 catalog_manager.cc:1347] Generated new cluster ID: ba7cfecae02745a797633d78a882bc59
I20260809 03:27:31.915470 31250 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:31.920279 31262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:31.914375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:42707 (local address 127.0.0.1:35873)
0809 03:27:31.914590 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:31.914599 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:31.914628 (+ 29us) server_negotiation.cc:407] Connection header received
0809 03:27:31.914751 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:31.914758 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:31.914830 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:31.915034 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:31.915284 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:31.916684 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:31.917919 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:31.918547 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:31.918639 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:31.919462 (+ 823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:31.919466 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:31.919466 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:31.919682 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:31.919717 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:31.919731 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:31.919804 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:31.919934 (+ 130us) server_negotiation.cc:299] Negotiation successful
0809 03:27:31.920073 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":74,"threads_started":1}
I20260809 03:27:31.921271 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:31.923000 31250 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:31.923815 31250 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:31.925912 31262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:31.922826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:42615 (local address 127.0.0.1:35873)
0809 03:27:31.922906 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:31.922908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:31.922950 (+ 42us) server_negotiation.cc:407] Connection header received
0809 03:27:31.923074 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:31.923075 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:31.923086 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:31.923131 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:31.923260 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:31.923710 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:31.924440 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:31.924675 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:31.924759 (+ 84us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:31.925591 (+ 832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:31.925593 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:31.925593 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:31.925597 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:31.925611 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:31.925615 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:31.925696 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:31.925793 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 03:27:31.925806 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 03:27:31.936273 31250 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ded3ad1864f450cb73c9d84ecc46c85: Generated new TSK 0
I20260809 03:27:31.936456 31250 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:31.944691 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 31164
W20260809 03:27:31.950433 31147 connection.cc:535] client connection to 127.0.0.1:35873 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35873): Connection reset by peer (error 104)
2026-08-09T03:27:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1366 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:32 dist-test-slave-2w3w krb5kdc[31272](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:32 dist-test-slave-2w3w krb5kdc[31272](info): set up 2 sockets
Aug 09 03:27:32 dist-test-slave-2w3w krb5kdc[31272](info): commencing operation
krb5kdc: starting...
W20260809 03:27:33.024421 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:33 dist-test-slave-2w3w krb5kdc[31272](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 03:27:33.145188 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46355
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46355
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:33.227177 31287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:33.227391 31287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:33.227416 31287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:33.228693 31287 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:33.228739 31287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:33.228755 31287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:33.228816 31287 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:33.228842 31287 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:33.230453 31287 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46355
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31287
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:33.230711 31287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:33.230993 31287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 03:27:33.236202 31287 server_base.cc:1034] running on GCE node
W20260809 03:27:33.236147 31294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:33.236174 31293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:33.236147 31296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:33.236630 31287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:33.236961 31287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:33.238147 31287 hybrid_clock.cc:648] HybridClock initialized: now 1786246053238139 us; error 37 us; skew 500 ppm
Aug 09 03:27:33 dist-test-slave-2w3w krb5kdc[31272](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246053, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:33.240939 31287 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 03:27:33.241398 31287 webserver.cc:460] Webserver started at http://127.0.0.1:46207/ using document root <none> and password file <none>
I20260809 03:27:33.241644 31287 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:33.241693 31287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:33.241791 31287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:33.242837 31287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "9c25928927094b74852d5959bb0dd14a"
format_stamp: "Formatted at 2026-08-09 03:27:33 on dist-test-slave-2w3w"
server_key: "a6a21e1cf51f24abadc93943320679c3"
server_key_iv: "1d3ab4174a277e7b1ada3f7d6e31fdc6"
server_key_version: "encryptionkey@0"
I20260809 03:27:33.243232 31287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "9c25928927094b74852d5959bb0dd14a"
format_stamp: "Formatted at 2026-08-09 03:27:33 on dist-test-slave-2w3w"
server_key: "a6a21e1cf51f24abadc93943320679c3"
server_key_iv: "1d3ab4174a277e7b1ada3f7d6e31fdc6"
server_key_version: "encryptionkey@0"
I20260809 03:27:33.244607 31287 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:33.245368 31305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:33.245537 31287 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:27:33.245613 31287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "9c25928927094b74852d5959bb0dd14a"
format_stamp: "Formatted at 2026-08-09 03:27:33 on dist-test-slave-2w3w"
server_key: "a6a21e1cf51f24abadc93943320679c3"
server_key_iv: "1d3ab4174a277e7b1ada3f7d6e31fdc6"
server_key_version: "encryptionkey@0"
I20260809 03:27:33.245666 31287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:33.249120 31287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:33.251520 31287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:33.251633 31287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:33.255848 31287 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46355
I20260809 03:27:33.255903 31359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46355 every 8 connection(s)
I20260809 03:27:33.256217 31287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:33.257215 31360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:33.259372 31360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a: Bootstrap starting.
I20260809 03:27:33.259863 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 31287
I20260809 03:27:33.259996 31360 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:33.260004 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:33.260221 8215 external_mini_cluster.cc:1428] Setting key 8c883436df350e8187e31369182c53e9
I20260809 03:27:33.260306 31360 log.cc:824] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:33.261097 31360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a: No bootstrap required, opened a new log
I20260809 03:27:33.262555 31364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:33.260686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:58441 (local address 127.0.0.1:46355)
0809 03:27:33.260855 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:33.260861 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:33.260887 (+ 26us) server_negotiation.cc:407] Connection header received
0809 03:27:33.261389 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:33.261395 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:33.261419 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:33.261534 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:33.262117 (+ 583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:33.262120 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:33.262121 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:33.262124 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:33.262158 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:33.262167 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:33.262216 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:33.262306 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 03:27:33.262361 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":68,"threads_started":1}
I20260809 03:27:33.263531 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:33.263760 31360 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c25928927094b74852d5959bb0dd14a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46355 } }
I20260809 03:27:33.263882 31360 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:33.263904 31360 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c25928927094b74852d5959bb0dd14a, State: Initialized, Role: FOLLOWER
I20260809 03:27:33.264030 31360 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c25928927094b74852d5959bb0dd14a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46355 } }
I20260809 03:27:33.264106 31360 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:33.264128 31360 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:33.264195 31360 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:33.264750 31360 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c25928927094b74852d5959bb0dd14a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46355 } }
I20260809 03:27:33.264864 31360 leader_election.cc:302] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c25928927094b74852d5959bb0dd14a; no voters:
I20260809 03:27:33.265035 31360 leader_election.cc:288] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:33.265096 31369 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:33.265214 31369 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a [term 1 LEADER]: Becoming Leader. State: Replica: 9c25928927094b74852d5959bb0dd14a, State: Running, Role: LEADER
I20260809 03:27:33.265285 31360 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:33.265368 31369 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c25928927094b74852d5959bb0dd14a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46355 } }
I20260809 03:27:33.265774 31373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c25928927094b74852d5959bb0dd14a. Latest consensus state: current_term: 1 leader_uuid: "9c25928927094b74852d5959bb0dd14a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c25928927094b74852d5959bb0dd14a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46355 } } }
I20260809 03:27:33.265882 31373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:33.266160 31364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:33.265004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:47979 (local address 127.0.0.1:46355)
0809 03:27:33.265044 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:33.265046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:33.265137 (+ 91us) server_negotiation.cc:407] Connection header received
0809 03:27:33.265221 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:33.265222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:33.265227 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:33.265279 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:33.265851 (+ 572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:33.265852 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:33.265852 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:33.265856 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:33.265869 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:33.265873 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:33.265919 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:33.266058 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 03:27:33.266083 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 03:27:33.265982 31372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c25928927094b74852d5959bb0dd14a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c25928927094b74852d5959bb0dd14a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46355 } } }
I20260809 03:27:33.266206 31372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:33.266372 31380 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:33.266893 31380 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:33.268512 31380 catalog_manager.cc:1347] Generated new cluster ID: 5bc8a4d17734456c91debdd04d66a036
I20260809 03:27:33.268550 31380 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:33.277877 31380 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:33.278045 31380 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:33.279824 31380 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c25928927094b74852d5959bb0dd14a: Generated new TSK 0
I20260809 03:27:33.279983 31380 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:33.284381 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 31287
2026-08-09T03:27:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1340 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:33 dist-test-slave-2w3w krb5kdc[31393](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:33 dist-test-slave-2w3w krb5kdc[31393](info): set up 2 sockets
Aug 09 03:27:33 dist-test-slave-2w3w krb5kdc[31393](info): commencing operation
krb5kdc: starting...
W20260809 03:27:34.356897 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:34 dist-test-slave-2w3w krb5kdc[31393](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:27:34.478107 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:38211
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:41363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:38211
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:34.560025 31407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:34.560271 31407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:34.560313 31407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:34.561466 31407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:34.561532 31407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:34.561559 31407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:34.561589 31407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:34.561618 31407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:34.563140 31407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:41363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:38211
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:38211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:34.563411 31407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:34.563634 31407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:34.568573 31412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:34.568679 31413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:34.568586 31415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:34.568617 31407 server_base.cc:1034] running on GCE node
I20260809 03:27:34.569017 31407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:34.569339 31407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:34.570520 31407 hybrid_clock.cc:648] HybridClock initialized: now 1786246054570504 us; error 27 us; skew 500 ppm
Aug 09 03:27:34 dist-test-slave-2w3w krb5kdc[31393](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246054, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:34.573102 31407 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:27:34.573544 31407 webserver.cc:460] Webserver started at http://127.8.5.254:41651/ using document root <none> and password file <none>
I20260809 03:27:34.573781 31407 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:34.573851 31407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:34.574008 31407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:34.575168 31407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "1bd6233b497c4d99896022228f63a0a9"
format_stamp: "Formatted at 2026-08-09 03:27:34 on dist-test-slave-2w3w"
server_key: "2a7046f47373b529206240aba324b606"
server_key_iv: "36b5ab75848307921dee072748975c27"
server_key_version: "encryptionkey@0"
I20260809 03:27:34.575538 31407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "1bd6233b497c4d99896022228f63a0a9"
format_stamp: "Formatted at 2026-08-09 03:27:34 on dist-test-slave-2w3w"
server_key: "2a7046f47373b529206240aba324b606"
server_key_iv: "36b5ab75848307921dee072748975c27"
server_key_version: "encryptionkey@0"
I20260809 03:27:34.576911 31407 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:27:34.577678 31422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:34.577879 31407 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:34.577987 31407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "1bd6233b497c4d99896022228f63a0a9"
format_stamp: "Formatted at 2026-08-09 03:27:34 on dist-test-slave-2w3w"
server_key: "2a7046f47373b529206240aba324b606"
server_key_iv: "36b5ab75848307921dee072748975c27"
server_key_version: "encryptionkey@0"
I20260809 03:27:34.578064 31407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:34.599828 31407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:34.601764 31407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:34.601946 31407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:34.606259 31407 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:38211
I20260809 03:27:34.606340 31477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:38211 every 8 connection(s)
I20260809 03:27:34.606691 31407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:34.607553 31478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:34.609867 31478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9: Bootstrap starting.
I20260809 03:27:34.610451 31478 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:34.610749 31478 log.cc:824] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:34.611505 31478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9: No bootstrap required, opened a new log
I20260809 03:27:34.613016 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 31407
I20260809 03:27:34.613143 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:34.613323 8215 external_mini_cluster.cc:1428] Setting key 005a6cde59599f030a486a81890e9c2c
I20260809 03:27:34.613281 31478 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bd6233b497c4d99896022228f63a0a9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38211 } }
I20260809 03:27:34.613473 31478 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:34.613526 31478 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bd6233b497c4d99896022228f63a0a9, State: Initialized, Role: FOLLOWER
I20260809 03:27:34.613675 31478 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bd6233b497c4d99896022228f63a0a9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38211 } }
I20260809 03:27:34.613793 31478 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:34.613849 31478 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:34.613940 31478 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:34.614714 31478 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bd6233b497c4d99896022228f63a0a9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38211 } }
I20260809 03:27:34.614845 31478 leader_election.cc:302] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1bd6233b497c4d99896022228f63a0a9; no voters:
I20260809 03:27:34.615025 31478 leader_election.cc:288] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:34.615064 31484 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:34.615240 31484 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9 [term 1 LEADER]: Becoming Leader. State: Replica: 1bd6233b497c4d99896022228f63a0a9, State: Running, Role: LEADER
I20260809 03:27:34.615278 31478 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:34.615410 31484 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bd6233b497c4d99896022228f63a0a9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38211 } }
I20260809 03:27:34.615895 31486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1bd6233b497c4d99896022228f63a0a9. Latest consensus state: current_term: 1 leader_uuid: "1bd6233b497c4d99896022228f63a0a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bd6233b497c4d99896022228f63a0a9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38211 } } }
I20260809 03:27:34.615990 31486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:34.616259 31493 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:34.616806 31493 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:34.616956 31485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1bd6233b497c4d99896022228f63a0a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bd6233b497c4d99896022228f63a0a9" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38211 } } }
I20260809 03:27:34.617028 31485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:34.618551 31493 catalog_manager.cc:1347] Generated new cluster ID: c0f1ebc47757439ca0c46271eb0a55bf
I20260809 03:27:34.618606 31493 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 03:27:34 dist-test-slave-2w3w krb5kdc[31393](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:34.625882 31483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:34.613816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58921 (local address 127.8.5.254:38211)
0809 03:27:34.614025 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:34.614035 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:34.614224 (+ 189us) server_negotiation.cc:407] Connection header received
0809 03:27:34.614646 (+ 422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:34.614656 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:34.614719 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:34.614931 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:34.615777 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:34.617352 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:34.618407 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:34.619023 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:34.619121 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:34.622046 (+ 2925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:34.622050 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:34.622050 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:34.622061 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:34.624123 (+ 2062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:34.624629 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:34.624632 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:34.624632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:34.624744 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:34.624991 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:34.624991 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:34.624992 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:34.625291 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:34.625450 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:34.625588 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 03:27:34.625681 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":95,"threads_started":1}
I20260809 03:27:34.626885 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:34.632407 31493 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:34.633044 31493 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:34.635680 31483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:34.628455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47337 (local address 127.8.5.254:38211)
0809 03:27:34.628491 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:34.628493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:34.628501 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:27:34.628520 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:34.628521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:34.628530 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:34.628590 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:34.629148 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:34.629901 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:34.630887 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:34.631272 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:34.631338 (+ 66us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:34.632755 (+ 1417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:34.632756 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:34.632756 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:34.632763 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:34.634326 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:34.634750 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:34.634751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:34.634751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:34.634810 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:34.635052 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:34.635053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:34.635054 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:34.635178 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:34.635307 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:34.635426 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 03:27:34.635489 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:27:34.641366 31493 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1bd6233b497c4d99896022228f63a0a9: Generated new TSK 0
I20260809 03:27:34.641537 31493 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:34.646569 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 31407
W20260809 03:27:34.653668 31391 connection.cc:535] client connection to 127.8.5.254:38211 recv error: Network error: failed to read from TLS socket (remote: 127.8.5.254:38211): Connection reset by peer (error 104)
2026-08-09T03:27:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1362 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:34 dist-test-slave-2w3w krb5kdc[31513](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:34 dist-test-slave-2w3w krb5kdc[31513](info): set up 2 sockets
Aug 09 03:27:34 dist-test-slave-2w3w krb5kdc[31513](info): commencing operation
krb5kdc: starting...
W20260809 03:27:35.724604 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:35 dist-test-slave-2w3w krb5kdc[31513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:27:35.845382 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:38393
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:34053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:38393
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:35.926149 31526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:35.926349 31526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:35.926371 31526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:35.927457 31526 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:35.927493 31526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:35.927507 31526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:35.927520 31526 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:35.927532 31526 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:35.928925 31526 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:34053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:38393
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:38393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:35.929109 31526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:35.929271 31526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:35.933902 31535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:35.934044 31533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:35.933898 31531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:35.934221 31526 server_base.cc:1034] running on GCE node
I20260809 03:27:35.934465 31526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:35.934810 31526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:35.935952 31526 hybrid_clock.cc:648] HybridClock initialized: now 1786246055935936 us; error 49 us; skew 500 ppm
Aug 09 03:27:35 dist-test-slave-2w3w krb5kdc[31513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246055, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:35.941947 31526 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:27:35.942358 31526 webserver.cc:460] Webserver started at http://127.8.5.254:46327/ using document root <none> and password file <none>
I20260809 03:27:35.942592 31526 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:35.942637 31526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:35.942725 31526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:35.943774 31526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "311b6918f84c46df9d68e390d2b25578"
format_stamp: "Formatted at 2026-08-09 03:27:35 on dist-test-slave-2w3w"
server_key: "44056a85b46462dbf875ab225299f3df"
server_key_iv: "f10b804e0a6929a4caf84137af71ffc8"
server_key_version: "encryptionkey@0"
I20260809 03:27:35.944087 31526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "311b6918f84c46df9d68e390d2b25578"
format_stamp: "Formatted at 2026-08-09 03:27:35 on dist-test-slave-2w3w"
server_key: "44056a85b46462dbf875ab225299f3df"
server_key_iv: "f10b804e0a6929a4caf84137af71ffc8"
server_key_version: "encryptionkey@0"
I20260809 03:27:35.945334 31526 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 03:27:35.946022 31543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:35.946195 31526 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:27:35.946302 31526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "311b6918f84c46df9d68e390d2b25578"
format_stamp: "Formatted at 2026-08-09 03:27:35 on dist-test-slave-2w3w"
server_key: "44056a85b46462dbf875ab225299f3df"
server_key_iv: "f10b804e0a6929a4caf84137af71ffc8"
server_key_version: "encryptionkey@0"
I20260809 03:27:35.946381 31526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:35.977594 31526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:35.979831 31526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:35.979983 31526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:35.984119 31526 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:38393
I20260809 03:27:35.984201 31597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:38393 every 8 connection(s)
I20260809 03:27:35.984557 31526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:35.985472 31598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:35.987753 31598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578: Bootstrap starting.
I20260809 03:27:35.988340 31598 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:35.988624 31598 log.cc:824] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:35.989425 31598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578: No bootstrap required, opened a new log
I20260809 03:27:35.990479 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 31526
I20260809 03:27:35.990615 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:35.990805 8215 external_mini_cluster.cc:1428] Setting key 6e2f40af9e4e48f1d25f810878b3d9f5
I20260809 03:27:35.991693 31598 raft_consensus.cc:348] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "311b6918f84c46df9d68e390d2b25578" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38393 } }
I20260809 03:27:35.991856 31598 raft_consensus.cc:374] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:35.991921 31598 raft_consensus.cc:729] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 311b6918f84c46df9d68e390d2b25578, State: Initialized, Role: FOLLOWER
I20260809 03:27:35.992079 31598 consensus_queue.cc:260] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "311b6918f84c46df9d68e390d2b25578" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38393 } }
I20260809 03:27:35.992215 31598 raft_consensus.cc:388] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:35.992260 31598 raft_consensus.cc:482] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:35.992311 31598 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:35.993059 31598 raft_consensus.cc:504] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "311b6918f84c46df9d68e390d2b25578" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38393 } }
I20260809 03:27:35.993180 31598 leader_election.cc:302] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 311b6918f84c46df9d68e390d2b25578; no voters:
I20260809 03:27:35.993340 31598 leader_election.cc:288] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:35.993407 31603 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:35.993641 31598 sys_catalog.cc:564] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:35.993652 31603 raft_consensus.cc:686] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578 [term 1 LEADER]: Becoming Leader. State: Replica: 311b6918f84c46df9d68e390d2b25578, State: Running, Role: LEADER
I20260809 03:27:35.993840 31603 consensus_queue.cc:237] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "311b6918f84c46df9d68e390d2b25578" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38393 } }
I20260809 03:27:35.994540 31603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "311b6918f84c46df9d68e390d2b25578" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "311b6918f84c46df9d68e390d2b25578" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38393 } } }
I20260809 03:27:35.994660 31603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:35.994887 31603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 311b6918f84c46df9d68e390d2b25578. Latest consensus state: current_term: 1 leader_uuid: "311b6918f84c46df9d68e390d2b25578" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "311b6918f84c46df9d68e390d2b25578" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38393 } } }
I20260809 03:27:35.995046 31603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578 [sys.catalog]: This master's current role is: LEADER
W20260809 03:27:35.995682 31618 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:27:35.995728 31618 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:27:35.996519 31614 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:35.996737 31614 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:35.997537 31602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:35.991387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50293 (local address 127.8.5.254:38393)
0809 03:27:35.991584 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:35.991592 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:35.991617 (+ 25us) server_negotiation.cc:407] Connection header received
0809 03:27:35.991717 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:35.991723 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:35.991773 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:35.991927 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:35.992359 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:35.993818 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:35.995054 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:35.995694 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:35.995826 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:35.996643 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:35.996647 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:35.996647 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:35.996858 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:35.996898 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:35.996912 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:35.996991 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:35.997249 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 03:27:35.997281 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":103,"threads_started":1}
I20260809 03:27:35.998603 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:35.998632 31614 catalog_manager.cc:1347] Generated new cluster ID: c858945451334a8d99859da920946883
I20260809 03:27:35.998701 31614 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:36.003623 31602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:36.000153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44737 (local address 127.8.5.254:38393)
0809 03:27:36.000188 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:36.000189 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:36.000260 (+ 71us) server_negotiation.cc:407] Connection header received
0809 03:27:36.000313 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:36.000314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:36.000324 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:36.000392 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:36.000497 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:36.001218 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:36.002210 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:36.002581 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:36.002673 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:36.003361 (+ 688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:36.003363 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:36.003364 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:36.003368 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:36.003386 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:36.003392 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:36.003458 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:36.003529 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 03:27:36.003542 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 03:27:36.011703 31614 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:36.012403 31614 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:36.022053 31614 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 311b6918f84c46df9d68e390d2b25578: Generated new TSK 0
I20260809 03:27:36.022264 31614 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:36.032155 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 31526
W20260809 03:27:36.038808 31510 connection.cc:535] client connection to 127.8.5.254:38393 recv error: Network error: failed to read from TLS socket (remote: 127.8.5.254:38393): Connection reset by peer (error 104)
2026-08-09T03:27:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1385 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:36 dist-test-slave-2w3w krb5kdc[31631](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:36 dist-test-slave-2w3w krb5kdc[31631](info): set up 2 sockets
Aug 09 03:27:36 dist-test-slave-2w3w krb5kdc[31631](info): commencing operation
krb5kdc: starting...
W20260809 03:27:37.100507 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.048s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:37 dist-test-slave-2w3w krb5kdc[31631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:27:37.223919 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:45467
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:45933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:45467
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:37.305269 31645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:37.305531 31645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:37.305574 31645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:37.306742 31645 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:37.306813 31645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:37.306836 31645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:37.306859 31645 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:37.306887 31645 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:37.308429 31645 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:45933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:45467
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:45467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:37.308755 31645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:37.309026 31645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:37.313905 31651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:37.313971 31654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:37.313911 31650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:37.314278 31645 server_base.cc:1034] running on GCE node
I20260809 03:27:37.314534 31645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:37.314904 31645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:37.316092 31645 hybrid_clock.cc:648] HybridClock initialized: now 1786246057316078 us; error 28 us; skew 500 ppm
Aug 09 03:27:37 dist-test-slave-2w3w krb5kdc[31631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246057, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:37.318517 31645 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:27:37.319016 31645 webserver.cc:460] Webserver started at http://127.8.5.254:43291/ using document root <none> and password file <none>
I20260809 03:27:37.319247 31645 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:37.319324 31645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:37.319484 31645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:37.320583 31645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "933fe4706e9c4c348a6950ceac20b046"
format_stamp: "Formatted at 2026-08-09 03:27:37 on dist-test-slave-2w3w"
server_key: "eb870e231fef3503f9b09dac83cb8bb3"
server_key_iv: "fb97001f40c98bab54b53aaba1e1fbee"
server_key_version: "encryptionkey@0"
I20260809 03:27:37.320966 31645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "933fe4706e9c4c348a6950ceac20b046"
format_stamp: "Formatted at 2026-08-09 03:27:37 on dist-test-slave-2w3w"
server_key: "eb870e231fef3503f9b09dac83cb8bb3"
server_key_iv: "fb97001f40c98bab54b53aaba1e1fbee"
server_key_version: "encryptionkey@0"
I20260809 03:27:37.322320 31645 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:27:37.323055 31661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:37.323233 31645 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:37.323335 31645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "933fe4706e9c4c348a6950ceac20b046"
format_stamp: "Formatted at 2026-08-09 03:27:37 on dist-test-slave-2w3w"
server_key: "eb870e231fef3503f9b09dac83cb8bb3"
server_key_iv: "fb97001f40c98bab54b53aaba1e1fbee"
server_key_version: "encryptionkey@0"
I20260809 03:27:37.323421 31645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:37.326656 31645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:37.328548 31645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:37.328708 31645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:37.332866 31645 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:45467
I20260809 03:27:37.332911 31714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:45467 every 8 connection(s)
I20260809 03:27:37.333252 31645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:37.334187 31715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:37.336514 31715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046: Bootstrap starting.
I20260809 03:27:37.337092 31715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:37.337392 31715 log.cc:824] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:37.338083 31715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046: No bootstrap required, opened a new log
I20260809 03:27:37.338712 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 31645
I20260809 03:27:37.338845 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:37.339099 8215 external_mini_cluster.cc:1428] Setting key c1ad240935c51f29d39ab786a9e1a199
I20260809 03:27:37.340456 31715 raft_consensus.cc:348] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "933fe4706e9c4c348a6950ceac20b046" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45467 } }
I20260809 03:27:37.340637 31715 raft_consensus.cc:374] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:37.340680 31715 raft_consensus.cc:729] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 933fe4706e9c4c348a6950ceac20b046, State: Initialized, Role: FOLLOWER
I20260809 03:27:37.340886 31715 consensus_queue.cc:260] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "933fe4706e9c4c348a6950ceac20b046" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45467 } }
I20260809 03:27:37.340996 31715 raft_consensus.cc:388] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:37.341073 31715 raft_consensus.cc:482] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:37.341148 31715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:37.341756 31719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:37.339657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51325 (local address 127.8.5.254:45467)
0809 03:27:37.339840 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:37.339853 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:37.339879 (+ 26us) server_negotiation.cc:407] Connection header received
0809 03:27:37.340428 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:37.340433 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:37.340459 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:37.340571 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:37.341320 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:37.341324 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:37.341324 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:37.341328 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:37.341384 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:37.341395 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:37.341466 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:37.341547 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 03:27:37.341588 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":87,"threads_started":1}
I20260809 03:27:37.342218 31715 raft_consensus.cc:504] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "933fe4706e9c4c348a6950ceac20b046" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45467 } }
I20260809 03:27:37.342375 31715 leader_election.cc:302] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 933fe4706e9c4c348a6950ceac20b046; no voters:
I20260809 03:27:37.342549 31715 leader_election.cc:288] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:37.342605 31720 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:37.342700 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:37.342756 31720 raft_consensus.cc:686] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046 [term 1 LEADER]: Becoming Leader. State: Replica: 933fe4706e9c4c348a6950ceac20b046, State: Running, Role: LEADER
I20260809 03:27:37.342828 31715 sys_catalog.cc:564] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:37.342888 31720 consensus_queue.cc:237] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "933fe4706e9c4c348a6950ceac20b046" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45467 } }
I20260809 03:27:37.343227 31720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 933fe4706e9c4c348a6950ceac20b046. Latest consensus state: current_term: 1 leader_uuid: "933fe4706e9c4c348a6950ceac20b046" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "933fe4706e9c4c348a6950ceac20b046" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45467 } } }
I20260809 03:27:37.343251 31722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "933fe4706e9c4c348a6950ceac20b046" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "933fe4706e9c4c348a6950ceac20b046" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 45467 } } }
I20260809 03:27:37.343339 31720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:37.343415 31722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:37.344259 31726 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:37.344859 31726 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:37.346544 31726 catalog_manager.cc:1347] Generated new cluster ID: ee9b8678a0b6481e81fdb68a56a79dd8
I20260809 03:27:37.346596 31726 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:37.350720 31719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:37.344324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36171 (local address 127.8.5.254:45467)
0809 03:27:37.344378 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:37.344380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:37.345500 (+ 1120us) server_negotiation.cc:407] Connection header received
0809 03:27:37.345567 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:37.345568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:37.345574 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:37.345617 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:37.346356 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:37.346357 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:37.346357 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:37.346362 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:37.346375 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:37.346380 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:37.346410 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:37.350616 (+ 4206us) server_negotiation.cc:299] Negotiation successful
0809 03:27:37.350638 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 03:27:37.356904 31726 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:37.357090 31726 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:37.362507 31726 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 933fe4706e9c4c348a6950ceac20b046: Generated new TSK 0
I20260809 03:27:37.362720 31726 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:37.370651 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 31645
2026-08-09T03:27:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1338 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:37 dist-test-slave-2w3w krb5kdc[31748](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:37 dist-test-slave-2w3w krb5kdc[31748](info): set up 2 sockets
Aug 09 03:27:37 dist-test-slave-2w3w krb5kdc[31748](info): commencing operation
krb5kdc: starting...
W20260809 03:27:38.440053 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:38 dist-test-slave-2w3w krb5kdc[31748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:27:38.566375 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:44173
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:44173
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:38.650215 31762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:38.650472 31762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:38.650514 31762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:38.651732 31762 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:38.651815 31762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:38.651840 31762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:38.651861 31762 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:38.651892 31762 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:38.653503 31762 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:44173
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:44173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31762
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:38.653806 31762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:38.654048 31762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:38.659248 31768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:38.659251 31767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:38.659250 31770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:38.659296 31762 server_base.cc:1034] running on GCE node
I20260809 03:27:38.659745 31762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:38.660064 31762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:38.661212 31762 hybrid_clock.cc:648] HybridClock initialized: now 1786246058661200 us; error 27 us; skew 500 ppm
Aug 09 03:27:38 dist-test-slave-2w3w krb5kdc[31748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246058, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:38.663787 31762 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:27:38.664175 31762 webserver.cc:460] Webserver started at http://127.8.5.254:46441/ using document root <none> and password file <none>
I20260809 03:27:38.664393 31762 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:38.664438 31762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:38.664529 31762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:38.665531 31762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "52aa0416bff44bb38955d67c01e21427"
format_stamp: "Formatted at 2026-08-09 03:27:38 on dist-test-slave-2w3w"
server_key: "732474e80ea06b61cc6b0123ed1ca9b2"
server_key_iv: "01f0fdf5051b5e2182544a1a75459c28"
server_key_version: "encryptionkey@0"
I20260809 03:27:38.665828 31762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "52aa0416bff44bb38955d67c01e21427"
format_stamp: "Formatted at 2026-08-09 03:27:38 on dist-test-slave-2w3w"
server_key: "732474e80ea06b61cc6b0123ed1ca9b2"
server_key_iv: "01f0fdf5051b5e2182544a1a75459c28"
server_key_version: "encryptionkey@0"
I20260809 03:27:38.667158 31762 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:27:38.667902 31780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:38.668102 31762 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:38.668185 31762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "52aa0416bff44bb38955d67c01e21427"
format_stamp: "Formatted at 2026-08-09 03:27:38 on dist-test-slave-2w3w"
server_key: "732474e80ea06b61cc6b0123ed1ca9b2"
server_key_iv: "01f0fdf5051b5e2182544a1a75459c28"
server_key_version: "encryptionkey@0"
I20260809 03:27:38.668238 31762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:38.680198 31762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:38.682137 31762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:38.682248 31762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:38.686163 31762 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:44173
I20260809 03:27:38.686244 31834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:44173 every 8 connection(s)
I20260809 03:27:38.686586 31762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:38.687517 31835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:38.689785 31835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427: Bootstrap starting.
I20260809 03:27:38.690384 31835 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:38.690691 31835 log.cc:824] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:38.691480 31835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427: No bootstrap required, opened a new log
I20260809 03:27:38.692090 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 31762
I20260809 03:27:38.692222 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:38.692427 8215 external_mini_cluster.cc:1428] Setting key 590e5ec2248a414be6412b09c7368398
I20260809 03:27:38.693786 31835 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52aa0416bff44bb38955d67c01e21427" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 44173 } }
I20260809 03:27:38.693969 31835 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:38.694015 31835 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52aa0416bff44bb38955d67c01e21427, State: Initialized, Role: FOLLOWER
I20260809 03:27:38.694159 31835 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52aa0416bff44bb38955d67c01e21427" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 44173 } }
I20260809 03:27:38.694248 31835 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:38.694283 31835 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:38.694334 31835 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:38.695470 31835 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52aa0416bff44bb38955d67c01e21427" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 44173 } }
I20260809 03:27:38.695601 31835 leader_election.cc:302] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52aa0416bff44bb38955d67c01e21427; no voters:
I20260809 03:27:38.695806 31835 leader_election.cc:288] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:38.695830 31840 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:38.695950 31840 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427 [term 1 LEADER]: Becoming Leader. State: Replica: 52aa0416bff44bb38955d67c01e21427, State: Running, Role: LEADER
I20260809 03:27:38.696099 31835 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:38.696204 31840 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52aa0416bff44bb38955d67c01e21427" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 44173 } }
I20260809 03:27:38.696681 31841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52aa0416bff44bb38955d67c01e21427. Latest consensus state: current_term: 1 leader_uuid: "52aa0416bff44bb38955d67c01e21427" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52aa0416bff44bb38955d67c01e21427" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 44173 } } }
I20260809 03:27:38.696779 31841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:38.696995 31842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52aa0416bff44bb38955d67c01e21427" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52aa0416bff44bb38955d67c01e21427" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 44173 } } }
I20260809 03:27:38.697319 31842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:38.697587 31849 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:38.698589 31849 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 03:27:38 dist-test-slave-2w3w krb5kdc[31748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:38.700496 31849 catalog_manager.cc:1347] Generated new cluster ID: 775fcb4a3a3e4455b9f50094df818f3b
I20260809 03:27:38.700555 31849 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:38.704061 31839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:38.692972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50837 (local address 127.8.5.254:44173)
0809 03:27:38.693155 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:38.693163 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:38.693284 (+ 121us) server_negotiation.cc:407] Connection header received
0809 03:27:38.693758 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:38.693764 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:38.693810 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:38.693933 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:38.694815 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:38.695904 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:38.696904 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:38.697509 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:38.697616 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:38.700686 (+ 3070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:38.700689 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:38.700690 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:38.700702 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:38.702423 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:38.702803 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:38.702806 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:38.702806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:38.702919 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:38.703176 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:38.703177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:38.703177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:38.703454 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:38.703629 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:38.703702 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 03:27:38.703848 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":91,"threads_started":1}
I20260809 03:27:38.704998 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:38.712584 31839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:38.706335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47847 (local address 127.8.5.254:44173)
0809 03:27:38.706376 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:38.706377 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:38.706475 (+ 98us) server_negotiation.cc:407] Connection header received
0809 03:27:38.706535 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:38.706536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:38.706547 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:38.706601 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:38.707178 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:38.707664 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:38.708378 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:38.708607 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:38.708691 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:38.709928 (+ 1237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:38.709929 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:38.709929 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:38.709937 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:38.711418 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:38.711783 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:38.711784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:38.711784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:38.711845 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:38.712052 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:38.712053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:38.712054 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:38.712168 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:38.712267 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:38.712388 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 03:27:38.712467 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:27:38.726380 31849 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:38.727166 31849 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:38.733580 31849 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 52aa0416bff44bb38955d67c01e21427: Generated new TSK 0
I20260809 03:27:38.733780 31849 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:38.742332 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 31762
2026-08-09T03:27:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1370 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:38 dist-test-slave-2w3w krb5kdc[31867](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:38 dist-test-slave-2w3w krb5kdc[31867](info): set up 2 sockets
Aug 09 03:27:38 dist-test-slave-2w3w krb5kdc[31867](info): commencing operation
krb5kdc: starting...
W20260809 03:27:39.829509 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:39 dist-test-slave-2w3w krb5kdc[31867](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:27:39.950220 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:33063
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:45031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:33063
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:40.033535 31880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:40.033735 31880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:40.033758 31880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:40.034858 31880 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:40.034897 31880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:40.034911 31880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:40.034924 31880 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:40.034936 31880 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:40.036755 31880 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:45031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:33063
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:33063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:40.036964 31880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:40.037129 31880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:40.041962 31888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:40.041977 31886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:40.042064 31880 server_base.cc:1034] running on GCE node
W20260809 03:27:40.041973 31885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:40.042413 31880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:40.042714 31880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:40.043898 31880 hybrid_clock.cc:648] HybridClock initialized: now 1786246060043886 us; error 47 us; skew 500 ppm
Aug 09 03:27:40 dist-test-slave-2w3w krb5kdc[31867](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246060, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:40.046378 31880 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:27:40.046839 31880 webserver.cc:460] Webserver started at http://127.8.5.254:40971/ using document root <none> and password file <none>
I20260809 03:27:40.047127 31880 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:40.047199 31880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:40.047336 31880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:40.048352 31880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "07931780c014400cbc676f47319ddce6"
format_stamp: "Formatted at 2026-08-09 03:27:40 on dist-test-slave-2w3w"
server_key: "55821b91665e8aabd392cdb8a28ffffe"
server_key_iv: "59c031d2b48d51a4b630f104b25edceb"
server_key_version: "encryptionkey@0"
I20260809 03:27:40.048717 31880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "07931780c014400cbc676f47319ddce6"
format_stamp: "Formatted at 2026-08-09 03:27:40 on dist-test-slave-2w3w"
server_key: "55821b91665e8aabd392cdb8a28ffffe"
server_key_iv: "59c031d2b48d51a4b630f104b25edceb"
server_key_version: "encryptionkey@0"
I20260809 03:27:40.050050 31880 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 03:27:40.050755 31895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:40.050995 31880 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:40.051084 31880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "07931780c014400cbc676f47319ddce6"
format_stamp: "Formatted at 2026-08-09 03:27:40 on dist-test-slave-2w3w"
server_key: "55821b91665e8aabd392cdb8a28ffffe"
server_key_iv: "59c031d2b48d51a4b630f104b25edceb"
server_key_version: "encryptionkey@0"
I20260809 03:27:40.051172 31880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:40.069280 31880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:40.071118 31880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:40.071277 31880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:40.075368 31880 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:33063
I20260809 03:27:40.075402 31951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:33063 every 8 connection(s)
I20260809 03:27:40.075735 31880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:40.076543 31952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:40.078732 31952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6: Bootstrap starting.
I20260809 03:27:40.079332 31952 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:40.079634 31952 log.cc:824] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:40.080309 31952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6: No bootstrap required, opened a new log
I20260809 03:27:40.081892 31952 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07931780c014400cbc676f47319ddce6" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33063 } }
I20260809 03:27:40.082021 31952 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:40.082082 31952 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07931780c014400cbc676f47319ddce6, State: Initialized, Role: FOLLOWER
I20260809 03:27:40.082235 31952 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07931780c014400cbc676f47319ddce6" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33063 } }
I20260809 03:27:40.082299 31952 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:40.082340 31952 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:40.082391 31952 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:40.083271 31952 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07931780c014400cbc676f47319ddce6" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33063 } }
I20260809 03:27:40.083359 31952 leader_election.cc:302] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07931780c014400cbc676f47319ddce6; no voters:
I20260809 03:27:40.083544 31952 leader_election.cc:288] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:40.083613 31956 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:40.083784 31956 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6 [term 1 LEADER]: Becoming Leader. State: Replica: 07931780c014400cbc676f47319ddce6, State: Running, Role: LEADER
I20260809 03:27:40.083806 31952 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:40.083917 31956 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07931780c014400cbc676f47319ddce6" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33063 } }
I20260809 03:27:40.084333 31957 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07931780c014400cbc676f47319ddce6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07931780c014400cbc676f47319ddce6" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33063 } } }
I20260809 03:27:40.084359 31958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07931780c014400cbc676f47319ddce6. Latest consensus state: current_term: 1 leader_uuid: "07931780c014400cbc676f47319ddce6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07931780c014400cbc676f47319ddce6" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 33063 } } }
I20260809 03:27:40.084509 31958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:40.084695 31957 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:40.084887 31967 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:40.085248 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 31880
I20260809 03:27:40.085390 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:40.085420 31967 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:40.085587 8215 external_mini_cluster.cc:1428] Setting key 7fa831bb4c74a081f9b8e79288a5d5d4
I20260809 03:27:40.087316 31967 catalog_manager.cc:1347] Generated new cluster ID: f805ce553c6941fe9e72f190a6b592a2
I20260809 03:27:40.087383 31967 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:40.091789 31978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:40.086045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47281 (local address 127.8.5.254:33063)
0809 03:27:40.086248 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:40.086260 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:40.086296 (+ 36us) server_negotiation.cc:407] Connection header received
0809 03:27:40.086469 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:40.086476 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:40.086534 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:40.086669 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:40.086904 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:40.088338 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:40.089510 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:40.090118 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:40.090219 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:40.090945 (+ 726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:40.090949 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:40.090950 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:40.091172 (+ 222us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:40.091208 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:40.091222 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:40.091286 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:40.091393 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 03:27:40.091550 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":8,"server-negotiator.queue_time_us":147,"thread_start_us":117,"threads_started":1}
I20260809 03:27:40.092655 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:40.092846 31967 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:40.093273 31967 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:40.097609 31978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:40.094136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35711 (local address 127.8.5.254:33063)
0809 03:27:40.094177 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:40.094178 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:40.094344 (+ 166us) server_negotiation.cc:407] Connection header received
0809 03:27:40.094407 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:40.094408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:40.094428 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:40.094480 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:40.094599 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:40.095340 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:40.096382 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:40.096664 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:40.096725 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:40.097361 (+ 636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:40.097362 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:40.097362 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:40.097379 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:40.097392 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:40.097396 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:40.097446 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:40.097517 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 03:27:40.097538 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 03:27:40.102854 31967 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07931780c014400cbc676f47319ddce6: Generated new TSK 0
I20260809 03:27:40.103044 31967 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:40.108381 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 31880
2026-08-09T03:27:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1366 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:40 dist-test-slave-2w3w krb5kdc[31990](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:40 dist-test-slave-2w3w krb5kdc[31990](info): set up 2 sockets
Aug 09 03:27:40 dist-test-slave-2w3w krb5kdc[31990](info): commencing operation
krb5kdc: starting...
W20260809 03:27:41.192822 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:41 dist-test-slave-2w3w krb5kdc[31990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246061, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:27:41.314164 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:35081
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:38331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:35081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:41.396842 32003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:41.397094 32003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:41.397135 32003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:41.398284 32003 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:41.398362 32003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:41.398391 32003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:41.398422 32003 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:41.398449 32003 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:41.400017 32003 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:38331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:35081
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:35081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:41.400288 32003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:41.400528 32003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 03:27:41.405629 32003 server_base.cc:1034] running on GCE node
W20260809 03:27:41.405587 32008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:41.405601 32012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:41.405589 32010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:41.406030 32003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:41.406324 32003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:41.407491 32003 hybrid_clock.cc:648] HybridClock initialized: now 1786246061407479 us; error 45 us; skew 500 ppm
Aug 09 03:27:41 dist-test-slave-2w3w krb5kdc[31990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246061, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:41.415247 32003 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:27:41.415788 32003 webserver.cc:460] Webserver started at http://127.8.5.254:33519/ using document root <none> and password file <none>
I20260809 03:27:41.416028 32003 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:41.416098 32003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:41.416253 32003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:41.417328 32003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "b04422b5cba54ba6ae42523f99ec1989"
format_stamp: "Formatted at 2026-08-09 03:27:41 on dist-test-slave-2w3w"
server_key: "b8c7fde50183ae12eddae228d37d70a5"
server_key_iv: "1521543986b03aa6839193f4a77720a1"
server_key_version: "encryptionkey@0"
I20260809 03:27:41.417697 32003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "b04422b5cba54ba6ae42523f99ec1989"
format_stamp: "Formatted at 2026-08-09 03:27:41 on dist-test-slave-2w3w"
server_key: "b8c7fde50183ae12eddae228d37d70a5"
server_key_iv: "1521543986b03aa6839193f4a77720a1"
server_key_version: "encryptionkey@0"
I20260809 03:27:41.419148 32003 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:27:41.419946 32019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:41.420188 32003 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:41.420291 32003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "b04422b5cba54ba6ae42523f99ec1989"
format_stamp: "Formatted at 2026-08-09 03:27:41 on dist-test-slave-2w3w"
server_key: "b8c7fde50183ae12eddae228d37d70a5"
server_key_iv: "1521543986b03aa6839193f4a77720a1"
server_key_version: "encryptionkey@0"
I20260809 03:27:41.420392 32003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:41.423804 32003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:41.425837 32003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:41.426019 32003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:41.430238 32003 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:35081
I20260809 03:27:41.430279 32074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:35081 every 8 connection(s)
I20260809 03:27:41.430624 32003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:41.431690 32075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:41.433981 32075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989: Bootstrap starting.
I20260809 03:27:41.434583 32075 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:41.434894 32075 log.cc:824] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:41.435593 32075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989: No bootstrap required, opened a new log
I20260809 03:27:41.437146 32075 raft_consensus.cc:348] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b04422b5cba54ba6ae42523f99ec1989" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35081 } }
I20260809 03:27:41.437278 32075 raft_consensus.cc:374] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 03:27:41.437300 32075 raft_consensus.cc:729] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04422b5cba54ba6ae42523f99ec1989, State: Initialized, Role: FOLLOWER
I20260809 03:27:41.437398 32075 consensus_queue.cc:260] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b04422b5cba54ba6ae42523f99ec1989" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35081 } }
I20260809 03:27:41.437450 32075 raft_consensus.cc:388] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 03:27:41.437470 32075 raft_consensus.cc:482] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 03:27:41.437546 32075 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:41.438365 32075 raft_consensus.cc:504] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b04422b5cba54ba6ae42523f99ec1989" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35081 } }
I20260809 03:27:41.438453 32075 leader_election.cc:302] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b04422b5cba54ba6ae42523f99ec1989; no voters:
I20260809 03:27:41.438629 32075 leader_election.cc:288] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 03:27:41.438679 32078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:41.438915 32075 sys_catalog.cc:564] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:41.438956 32078 raft_consensus.cc:686] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989 [term 1 LEADER]: Becoming Leader. State: Replica: b04422b5cba54ba6ae42523f99ec1989, State: Running, Role: LEADER
I20260809 03:27:41.439119 32078 consensus_queue.cc:237] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b04422b5cba54ba6ae42523f99ec1989" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35081 } }
I20260809 03:27:41.439460 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 32003
I20260809 03:27:41.439508 32081 sys_catalog.cc:455] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b04422b5cba54ba6ae42523f99ec1989. Latest consensus state: current_term: 1 leader_uuid: "b04422b5cba54ba6ae42523f99ec1989" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b04422b5cba54ba6ae42523f99ec1989" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35081 } } }
I20260809 03:27:41.439492 32079 sys_catalog.cc:455] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b04422b5cba54ba6ae42523f99ec1989" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b04422b5cba54ba6ae42523f99ec1989" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 35081 } } }
I20260809 03:27:41.439590 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:41.439590 32081 sys_catalog.cc:458] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:41.439596 32079 sys_catalog.cc:458] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989 [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:41.439795 8215 external_mini_cluster.cc:1428] Setting key 92edd7cf2ba98438c7f0c802f9575a8f
I20260809 03:27:41.439829 32089 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:41.440371 32089 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:41.442137 32100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:41.440416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39649 (local address 127.8.5.254:35081)
0809 03:27:41.440636 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:41.440645 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:41.440682 (+ 37us) server_negotiation.cc:407] Connection header received
0809 03:27:41.440855 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:41.440863 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:41.440894 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:41.441049 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:41.441703 (+ 654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:41.441706 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:41.441707 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:41.441712 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:41.441772 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:41.441788 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:41.441858 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:41.441938 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 03:27:41.441980 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":86,"threads_started":1}
I20260809 03:27:41.442691 32089 catalog_manager.cc:1347] Generated new cluster ID: 3d0f68c8ffd04371b2a1e6887e7dfff9
I20260809 03:27:41.442773 32089 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:41.443171 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:41.445652 32100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:41.444582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53017 (local address 127.8.5.254:35081)
0809 03:27:41.444621 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:41.444623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:41.444719 (+ 96us) server_negotiation.cc:407] Connection header received
0809 03:27:41.444808 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:41.444809 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:41.444814 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:41.444839 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:41.445455 (+ 616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:41.445456 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:41.445456 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 03:27:41.445460 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:41.445472 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 03:27:41.445475 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:41.445501 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:41.445586 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 03:27:41.445596 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:27:41.454028 32089 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:41.454195 32089 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:41.462589 32089 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b04422b5cba54ba6ae42523f99ec1989: Generated new TSK 0
I20260809 03:27:41.462764 32089 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 03:27:41.465317 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 32003
2026-08-09T03:27:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1356 ms)
[----------] 18 tests from AuthTokenIssuingTest (24603 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:41 dist-test-slave-2w3w krb5kdc[32109](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:41 dist-test-slave-2w3w krb5kdc[32109](info): set up 2 sockets
Aug 09 03:27:41 dist-test-slave-2w3w krb5kdc[32109](info): commencing operation
krb5kdc: starting...
W20260809 03:27:42.544091 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:42 dist-test-slave-2w3w krb5kdc[32109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:27:42.668018 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:38823
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:38823,127.8.5.253:38623,127.8.5.252:46795
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:42.750164 32123 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 03:27:42.750386 32123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:42.750406 32123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:42.750425 32123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:42.751509 32123 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:42.751543 32123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:42.751557 32123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:42.751570 32123 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:42.751582 32123 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:42.753005 32123 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:38823,127.8.5.253:38623,127.8.5.252:46795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:38823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32123
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:42.753198 32123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:42.753382 32123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:42.758257 32128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:42.758240 32129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:42.758476 32123 server_base.cc:1034] running on GCE node
W20260809 03:27:42.758253 32131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:42.758759 32123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:42.759105 32123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:42.760270 32123 hybrid_clock.cc:648] HybridClock initialized: now 1786246062760260 us; error 41 us; skew 500 ppm
Aug 09 03:27:42 dist-test-slave-2w3w krb5kdc[32109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246062, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:42.762850 32123 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:27:42.763388 32123 webserver.cc:460] Webserver started at http://127.8.5.254:33709/ using document root <none> and password file <none>
I20260809 03:27:42.763624 32123 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:42.763691 32123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:42.763828 32123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:42.764899 32123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb"
format_stamp: "Formatted at 2026-08-09 03:27:42 on dist-test-slave-2w3w"
server_key: "79317b247235e40d148d496ea5548d38"
server_key_iv: "eab7a53d410bed2f921e1e17da779a11"
server_key_version: "encryptionkey@0"
I20260809 03:27:42.765260 32123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb"
format_stamp: "Formatted at 2026-08-09 03:27:42 on dist-test-slave-2w3w"
server_key: "79317b247235e40d148d496ea5548d38"
server_key_iv: "eab7a53d410bed2f921e1e17da779a11"
server_key_version: "encryptionkey@0"
I20260809 03:27:42.766688 32123 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:27:42.767486 32139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:42.767669 32123 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:42.767768 32123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb"
format_stamp: "Formatted at 2026-08-09 03:27:42 on dist-test-slave-2w3w"
server_key: "79317b247235e40d148d496ea5548d38"
server_key_iv: "eab7a53d410bed2f921e1e17da779a11"
server_key_version: "encryptionkey@0"
I20260809 03:27:42.767854 32123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:42.784230 32123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:42.786501 32123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:42.786672 32123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:42.790900 32123 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:38823
I20260809 03:27:42.790936 32197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:38823 every 8 connection(s)
I20260809 03:27:42.791410 32123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:42.792383 32198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:42.793284 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 32123
I20260809 03:27:42.793413 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:42.793593 8215 external_mini_cluster.cc:1428] Setting key 531b510e581fce273ea763448f7ea712
I20260809 03:27:42.794060 32198 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 03:27:42 dist-test-slave-2w3w krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246062, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.5.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.253@KRBTEST.COM" created.
I20260809 03:27:42.805923 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:42.794720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38823 (local address 127.0.0.1:52468)
0809 03:27:42.794923 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:42.794997 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:42.795648 (+ 651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:42.796008 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:42.796010 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:42.796238 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:42.796389 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:42.796393 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:42.798070 (+ 1677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:42.798071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:42.798804 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:42.798806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:42.799514 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:42.799515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:42.799609 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:42.800157 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:42.800169 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:42.801891 (+ 1722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:42.804164 (+ 2273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:42.804172 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:42.804175 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:42.804401 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:42.804694 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:42.804695 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:42.804696 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:42.804828 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:42.805182 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:42.805187 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:42.805293 (+ 106us) client_negotiation.cc:769] Sending connection context
0809 03:27:42.805409 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 03:27:42.805667 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":96,"thread_start_us":108,"threads_started":1}
I20260809 03:27:42.805936 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:42.794794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52468 (local address 127.8.5.254:38823)
0809 03:27:42.794975 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:42.794985 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:42.795098 (+ 113us) server_negotiation.cc:407] Connection header received
0809 03:27:42.795844 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:42.795847 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:42.795874 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:42.795996 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:42.796512 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:42.797970 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:42.798923 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:42.799398 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:42.799490 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:42.802008 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:42.802017 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:42.802017 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:42.802031 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:42.804032 (+ 2001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:42.804506 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:42.804509 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:42.804509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:42.804599 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:42.804896 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:42.804896 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:42.804897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:42.805118 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:42.805189 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:42.805447 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 03:27:42.805592 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":68,"threads_started":1}
I20260809 03:27:42.806800 32198 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:27:42.807178 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:42.807061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38623 (local address 127.0.0.1:34134)
0809 03:27:42.807110 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:42.807160 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.253:38623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 03:27:42.807353 32141 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.5.253:38623: connect: Connection refused (error 111)
I20260809 03:27:42.807884 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:42.807772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38623 (local address 127.0.0.1:34148)
0809 03:27:42.807826 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:42.807857 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.253:38623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 03:27:42.808004 32198 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.253:38623: Network error: Client connection negotiation failed: client connection to 127.8.5.253:38623: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.253.keytab.
Entry for principal kudu/127.8.5.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.253.keytab.
I20260809 03:27:42.821763 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.253:38623
--webserver_interface=127.8.5.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.253.keytab
--principal=kudu/127.8.5.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:38823,127.8.5.253:38623,127.8.5.252:46795
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 03:27:42.857251 32198 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } attempt: 1
I20260809 03:27:42.857862 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:42.857674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38623 (local address 127.0.0.1:34152)
0809 03:27:42.857749 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:42.857811 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.253:38623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 03:27:42.858443 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:42.858276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38623 (local address 127.0.0.1:34164)
0809 03:27:42.858333 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:42.858407 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.253:38623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 03:27:42.858603 32198 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.253:38623: Network error: Client connection negotiation failed: client connection to 127.8.5.253:38623: connect: Connection refused (error 111)
W20260809 03:27:42.904258 32205 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 03:27:42.904460 32205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:42.904477 32205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:42.904497 32205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:42.905525 32205 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:42.905557 32205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:42.905572 32205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:42.905584 32205 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:42.905596 32205 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:42.906986 32205 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:38823,127.8.5.253:38623,127.8.5.252:46795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.253.keytab
--principal=kudu/127.8.5.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.253:38623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.5.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:42.907169 32205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:42.907330 32205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:42.912118 32211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:42.912153 32213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:42.912168 32210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:42.912335 32205 server_base.cc:1034] running on GCE node
I20260809 03:27:42.912601 32205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:42.912847 32205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:42.914016 32205 hybrid_clock.cc:648] HybridClock initialized: now 1786246062913999 us; error 46 us; skew 500 ppm
Aug 09 03:27:42 dist-test-slave-2w3w krb5kdc[32109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246062, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:42.916661 32205 init.cc:377] Logged in from keytab as kudu/127.8.5.253@KRBTEST.COM (short username kudu)
I20260809 03:27:42.917096 32205 webserver.cc:460] Webserver started at http://127.8.5.253:38099/ using document root <none> and password file <none>
I20260809 03:27:42.917320 32205 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:42.917395 32205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:42.917550 32205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:42.918583 32205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-1/data/instance:
uuid: "621e85ab496b4fe69be8054bd42864ef"
format_stamp: "Formatted at 2026-08-09 03:27:42 on dist-test-slave-2w3w"
server_key: "3fb3784ba7a6000d2b4d8b133b012a87"
server_key_iv: "b8a5ab5e35e5ff89e1798cb6c78d395c"
server_key_version: "encryptionkey@0"
I20260809 03:27:42.919008 32205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-1/wal/instance:
uuid: "621e85ab496b4fe69be8054bd42864ef"
format_stamp: "Formatted at 2026-08-09 03:27:42 on dist-test-slave-2w3w"
server_key: "3fb3784ba7a6000d2b4d8b133b012a87"
server_key_iv: "b8a5ab5e35e5ff89e1798cb6c78d395c"
server_key_version: "encryptionkey@0"
I20260809 03:27:42.920367 32205 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:42.921068 32221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:42.921236 32205 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 03:27:42.921334 32205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-1/wal
uuid: "621e85ab496b4fe69be8054bd42864ef"
format_stamp: "Formatted at 2026-08-09 03:27:42 on dist-test-slave-2w3w"
server_key: "3fb3784ba7a6000d2b4d8b133b012a87"
server_key_iv: "b8a5ab5e35e5ff89e1798cb6c78d395c"
server_key_version: "encryptionkey@0"
I20260809 03:27:42.921435 32205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:42.926784 32198 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } attempt: 2
I20260809 03:27:42.927248 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:42.927120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38623 (local address 127.0.0.1:34168)
0809 03:27:42.927178 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:42.927217 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.253:38623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 03:27:42.927618 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:42.927519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38623 (local address 127.0.0.1:34178)
0809 03:27:42.927566 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:42.927593 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.253:38623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 03:27:42.927731 32198 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.253:38623: Network error: Client connection negotiation failed: client connection to 127.8.5.253:38623: connect: Connection refused (error 111)
I20260809 03:27:42.930657 32205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:42.932981 32205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:42.933143 32205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:42.937120 32205 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.253:38623
I20260809 03:27:42.937151 32275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.253:38623 every 8 connection(s)
I20260809 03:27:42.937510 32205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-1/data/info.pb
I20260809 03:27:42.938464 32276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:42.939988 32276 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 03:27:42 dist-test-slave-2w3w krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246062, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.253@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:42.947147 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 32205
I20260809 03:27:42.947233 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-1/wal/instance
I20260809 03:27:42.947474 8215 external_mini_cluster.cc:1428] Setting key 159952618d8c2a270167a139112b00ad
I20260809 03:27:42.948371 32279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:42.940573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38823 (local address 127.0.0.1:52482)
0809 03:27:42.940720 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:42.940761 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:42.941207 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:42.941407 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:42.941409 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:42.941637 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:42.941821 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:42.941825 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:42.942452 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:42.942452 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:42.943308 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:42.943310 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:42.943664 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:42.943665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:42.943770 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:42.944252 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:42.944260 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:42.945563 (+ 1303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:42.946911 (+ 1348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:42.946918 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:42.946920 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:42.947183 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:42.947442 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:42.947443 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:42.947443 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:42.947588 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:42.947892 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:42.947897 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:42.948010 (+ 113us) client_negotiation.cc:769] Sending connection context
0809 03:27:42.948089 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 03:27:42.948204 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":74,"threads_started":1}
I20260809 03:27:42.948370 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:42.940604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52482 (local address 127.8.5.254:38823)
0809 03:27:42.940665 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:42.940667 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:42.940842 (+ 175us) server_negotiation.cc:407] Connection header received
0809 03:27:42.941283 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:42.941284 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:42.941295 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:42.941348 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:42.941892 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:42.942364 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:42.943386 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:42.943577 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:42.943631 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:42.945648 (+ 2017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:42.945650 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:42.945650 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:42.945656 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:42.946842 (+ 1186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:42.947290 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:42.947291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:42.947291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:42.947361 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:42.947659 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:42.947660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:42.947661 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:42.947812 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:42.947897 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:42.948135 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 03:27:42.948230 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 03:27:42.949051 32276 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 03:27:42 dist-test-slave-2w3w krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246062, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.253@KRBTEST.COM for kudu/127.8.5.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.5.252@KRBTEST.COM; defaulting to no policy
I20260809 03:27:42.957315 32279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:42.949308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38623 (local address 127.0.0.1:34190)
0809 03:27:42.949406 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:42.949419 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:42.949466 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:42.949674 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:42.949675 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:42.949835 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:42.949896 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:42.949898 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:42.950838 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:42.950839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:42.951400 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:42.951402 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:42.952108 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:42.952109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:42.952165 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:42.952586 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:42.952590 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:42.954033 (+ 1443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:42.955980 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:42.955981 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:42.955981 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:42.956218 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:42.956564 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:42.956565 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:42.956566 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:42.956634 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:42.957027 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:42.957029 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:42.957077 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 03:27:42.957156 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 03:27:42.957250 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 03:27:42.957479 32281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:42.949348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34190 (local address 127.8.5.253:38623)
0809 03:27:42.949538 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:42.949542 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:42.949558 (+ 16us) server_negotiation.cc:407] Connection header received
0809 03:27:42.949585 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:42.949587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:42.949597 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:42.949658 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:42.949973 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:42.950761 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:42.951478 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:42.952019 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:42.952101 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:42.954119 (+ 2018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:42.954127 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:42.954127 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:42.954133 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:42.955884 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:42.956417 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:42.956420 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:42.956420 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:42.956485 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:42.956704 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:42.956704 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:42.956705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:42.956948 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:42.957022 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:42.957195 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 03:27:42.957307 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":166,"thread_start_us":106,"threads_started":1}
I20260809 03:27:42.958093 32276 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:27:42.958478 32279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:42.958347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:46795 (local address 127.0.0.1:43446)
0809 03:27:42.958402 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:42.958451 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 03:27:42.958611 32225 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.5.252:46795: connect: Connection refused (error 111)
I20260809 03:27:42.959100 32279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:42.959003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:46795 (local address 127.0.0.1:43458)
0809 03:27:42.959038 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:42.959071 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260809 03:27:42.959259 32276 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.252:46795: Network error: Client connection negotiation failed: client connection to 127.8.5.252:46795: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.252.keytab.
Entry for principal kudu/127.8.5.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.252.keytab.
I20260809 03:27:42.976155 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.252:46795
--webserver_interface=127.8.5.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.252.keytab
--principal=kudu/127.8.5.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:44497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:38823,127.8.5.253:38623,127.8.5.252:46795
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 03:27:43.008546 32276 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } attempt: 1
I20260809 03:27:43.009133 32279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.008963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:46795 (local address 127.0.0.1:43462)
0809 03:27:43.009039 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:43.009091 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 03:27:43.009609 32279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.009485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:46795 (local address 127.0.0.1:43464)
0809 03:27:43.009532 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:43.009565 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 03:27:43.009761 32276 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.252:46795: Network error: Client connection negotiation failed: client connection to 127.8.5.252:46795: connect: Connection refused (error 111)
I20260809 03:27:43.018885 32198 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } attempt: 3
Aug 09 03:27:43 dist-test-slave-2w3w krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246062, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for kudu/127.8.5.253@KRBTEST.COM
I20260809 03:27:43.028048 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.019300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38623 (local address 127.0.0.1:34192)
0809 03:27:43.019451 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:43.019463 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:43.019570 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:43.019765 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:43.019765 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:43.020005 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:43.020094 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:43.020097 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.021269 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.021271 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:43.022369 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:43.022373 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.022875 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.022876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:43.022987 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:43.023506 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:43.023513 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:43.025029 (+ 1516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:43.027029 (+ 2000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:43.027030 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:43.027031 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:43.027235 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:43.027455 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:43.027456 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:43.027456 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:43.027512 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:43.027761 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:43.027761 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:43.027806 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 03:27:43.027851 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 03:27:43.027946 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131}
I20260809 03:27:43.028388 32281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.019375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34192 (local address 127.8.5.253:38623)
0809 03:27:43.019424 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.019426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.019567 (+ 141us) server_negotiation.cc:407] Connection header received
0809 03:27:43.019645 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.019646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.019662 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.019755 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.020190 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.021131 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.022468 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.022791 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.025112 (+ 2321us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:43.025231 (+ 119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:43.025232 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:43.025232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:43.025238 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:43.026907 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.027316 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.027317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.027317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.027384 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.027574 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.027574 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.027575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.027695 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:43.028170 (+ 475us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:43.028213 (+ 43us) server_negotiation.cc:299] Negotiation successful
0809 03:27:43.028292 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 03:27:43.031445 32198 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:27:43.031833 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.031719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:46795 (local address 127.0.0.1:43474)
0809 03:27:43.031772 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:43.031802 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 03:27:43.032150 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.032053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:46795 (local address 127.0.0.1:43482)
0809 03:27:43.032101 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:43.032128 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 03:27:43.032254 32198 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.252:46795: Network error: Client connection negotiation failed: client connection to 127.8.5.252:46795: connect: Connection refused (error 111)
I20260809 03:27:43.063434 32198 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } attempt: 1
I20260809 03:27:43.063931 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.063767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:46795 (local address 127.0.0.1:43494)
0809 03:27:43.063840 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:43.063890 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 03:27:43.064314 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.064198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:46795 (local address 127.0.0.1:43508)
0809 03:27:43.064250 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:43.064282 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 03:27:43.064422 32198 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.252:46795: Network error: Client connection negotiation failed: client connection to 127.8.5.252:46795: connect: Connection refused (error 111)
W20260809 03:27:43.066709 32284 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 03:27:43.066903 32284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:43.066942 32284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:43.067000 32284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:43.068116 32284 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:43.068154 32284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:43.068169 32284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:43.068218 32284 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:43.068239 32284 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:43.069765 32284 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:44497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:38823,127.8.5.253:38623,127.8.5.252:46795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.252.keytab
--principal=kudu/127.8.5.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.252:46795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.5.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:43.070024 32284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:43.070264 32284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:43.075078 32291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:43.075094 32292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:43.075078 32294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:43.075292 32284 server_base.cc:1034] running on GCE node
I20260809 03:27:43.075572 32284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:43.075907 32284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:43.077076 32284 hybrid_clock.cc:648] HybridClock initialized: now 1786246063077060 us; error 45 us; skew 500 ppm
I20260809 03:27:43.077939 32276 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } attempt: 2
I20260809 03:27:43.078333 32279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.078209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:46795 (local address 127.0.0.1:43524)
0809 03:27:43.078269 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:43.078304 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 03:27:43.078764 32279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.078679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:46795 (local address 127.0.0.1:43532)
0809 03:27:43.078721 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:43.078747 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 03:27:43.078877 32276 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.252:46795: Network error: Client connection negotiation failed: client connection to 127.8.5.252:46795: connect: Connection refused (error 111)
Aug 09 03:27:43 dist-test-slave-2w3w krb5kdc[32109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246063, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:43.079981 32284 init.cc:377] Logged in from keytab as kudu/127.8.5.252@KRBTEST.COM (short username kudu)
I20260809 03:27:43.080452 32284 webserver.cc:460] Webserver started at http://127.8.5.252:45305/ using document root <none> and password file <none>
I20260809 03:27:43.080698 32284 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:43.080777 32284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:43.080926 32284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:43.081956 32284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-2/data/instance:
uuid: "432f6351fbcd4052b50f86455945b854"
format_stamp: "Formatted at 2026-08-09 03:27:43 on dist-test-slave-2w3w"
server_key: "502019923527b7314f519034d276f8dc"
server_key_iv: "dc3bab97f60d6b53b3326bc796da1e3c"
server_key_version: "encryptionkey@0"
I20260809 03:27:43.082312 32284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-2/wal/instance:
uuid: "432f6351fbcd4052b50f86455945b854"
format_stamp: "Formatted at 2026-08-09 03:27:43 on dist-test-slave-2w3w"
server_key: "502019923527b7314f519034d276f8dc"
server_key_iv: "dc3bab97f60d6b53b3326bc796da1e3c"
server_key_version: "encryptionkey@0"
I20260809 03:27:43.083774 32284 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:27:43.084491 32302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:43.084671 32284 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:43.084803 32284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-2/wal
uuid: "432f6351fbcd4052b50f86455945b854"
format_stamp: "Formatted at 2026-08-09 03:27:43 on dist-test-slave-2w3w"
server_key: "502019923527b7314f519034d276f8dc"
server_key_iv: "dc3bab97f60d6b53b3326bc796da1e3c"
server_key_version: "encryptionkey@0"
I20260809 03:27:43.084896 32284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:43.098832 32284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:43.100837 32284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:43.101017 32284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:43.105325 32284 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.252:46795
I20260809 03:27:43.105361 32355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.252:46795 every 8 connection(s)
I20260809 03:27:43.105717 32284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-2/data/info.pb
I20260809 03:27:43.106698 32356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:43.108225 32356 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:27:43.111850 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 32284
I20260809 03:27:43.111928 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786245797426041-8215-0/minicluster-data/master-2/wal/instance
I20260809 03:27:43.112128 8215 external_mini_cluster.cc:1428] Setting key 7a0a33b81f0d9d1b657bba1ef85cd2f6
Aug 09 03:27:43 dist-test-slave-2w3w krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246063, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.252@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
Aug 09 03:27:43 dist-test-slave-2w3w krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.252@KRBTEST.COM
I20260809 03:27:43.118257 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.109029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52488 (local address 127.8.5.254:38823)
0809 03:27:43.109097 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.109099 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.109303 (+ 204us) server_negotiation.cc:407] Connection header received
0809 03:27:43.109773 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.109774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.109783 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.109844 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.110453 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.110944 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.112001 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.112302 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.112378 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:43.114722 (+ 2344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:43.114723 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:43.114723 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:43.114730 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:43.116746 (+ 2016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.117244 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.117245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.117245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.117296 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.117594 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.117595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.117595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.117734 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:43.117813 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:43.118070 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 03:27:43.118159 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 03:27:43.118408 32359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.108991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:38823 (local address 127.0.0.1:52488)
0809 03:27:43.109172 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:43.109213 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:43.109668 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:43.109910 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:43.109914 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:43.110153 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:43.110344 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:43.110348 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.111092 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.111092 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:43.111879 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:43.111880 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.112421 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.112422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:43.112597 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:43.113180 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:43.113187 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:43.114635 (+ 1448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:43.116833 (+ 2198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:43.116841 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:43.116844 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:43.117165 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:43.117379 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:43.117380 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:43.117381 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:43.117521 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:43.117807 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:43.117812 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:43.117928 (+ 116us) client_negotiation.cc:769] Sending connection context
0809 03:27:43.118009 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 03:27:43.118160 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":88,"threads_started":1}
I20260809 03:27:43.119073 32356 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:27:43.121469 32361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.112532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43540 (local address 127.8.5.252:46795)
0809 03:27:43.112729 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.112735 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.112776 (+ 41us) server_negotiation.cc:407] Connection header received
0809 03:27:43.112859 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.112864 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.112900 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.112958 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.113628 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.114403 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.115401 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.115900 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.115974 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:43.118646 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:43.118652 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:43.118652 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:43.118659 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:43.120437 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.120747 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.120750 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.120750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.120811 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.120947 (+ 136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.120947 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.120947 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.121093 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:43.121221 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:43.121316 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 03:27:43.121374 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":100,"threads_started":1}
Aug 09 03:27:43 dist-test-slave-2w3w krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246063, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.252@KRBTEST.COM for kudu/127.8.5.253@KRBTEST.COM
I20260809 03:27:43.126125 32281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.119404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34208 (local address 127.8.5.253:38623)
0809 03:27:43.119446 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.119448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.119455 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:27:43.119483 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.119483 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.119500 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.119545 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.119834 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.120262 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.121121 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.121451 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.121518 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:43.123522 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:43.123524 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:43.123524 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:43.123532 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:43.124995 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.125343 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.125344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.125344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.125402 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.125621 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.125621 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.125622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.125741 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:43.125815 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:43.125967 (+ 152us) server_negotiation.cc:299] Negotiation successful
0809 03:27:43.126037 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:27:43.126123 32359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.119328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:38623 (local address 127.0.0.1:34208)
0809 03:27:43.119378 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:43.119389 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:43.119428 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:43.119550 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:43.119551 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:43.119686 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:43.119765 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:43.119767 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.120345 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.120346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:43.121051 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:43.121053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.121620 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.121621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:43.121700 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:43.122119 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:43.122124 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:43.123434 (+ 1310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:43.125081 (+ 1647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:43.125082 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:43.125082 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:43.125255 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:43.125479 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:43.125480 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:43.125480 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:43.125542 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:43.125808 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:43.125809 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:43.125850 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 03:27:43.125939 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 03:27:43.126032 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
Aug 09 03:27:43 dist-test-slave-2w3w krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:43.126466 32356 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:27:43.129657 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.122174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52496 (local address 127.8.5.254:38823)
0809 03:27:43.122215 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.122217 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.122249 (+ 32us) server_negotiation.cc:407] Connection header received
0809 03:27:43.122270 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.122271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.122281 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.122346 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.122846 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.123414 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.124263 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.124585 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.124672 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:43.126908 (+ 2236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:43.126909 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:43.126910 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:43.126917 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:43.128506 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.128869 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.128870 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.128870 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.128920 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.129106 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.129107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.129107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.129244 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:43.129412 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:43.129454 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 03:27:43.129539 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
Aug 09 03:27:43 dist-test-slave-2w3w krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246063, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.252@KRBTEST.COM for kudu/127.8.5.252@KRBTEST.COM
I20260809 03:27:43.133559 32359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.126690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:46795 (local address 127.0.0.1:43546)
0809 03:27:43.126741 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:43.126752 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:43.126787 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:43.126923 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:43.126924 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:43.127104 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:43.127142 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:43.127144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.127955 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.127957 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:43.128700 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:43.128703 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.129183 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.129184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:43.129244 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:43.129665 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:43.129670 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:43.130868 (+ 1198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:43.132463 (+ 1595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:43.132463 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:43.132464 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:43.132624 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:43.132960 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:43.132960 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:43.132960 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:43.133010 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:43.133254 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:43.133254 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:43.133290 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 03:27:43.133359 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 03:27:43.133455 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 03:27:43.133613 32361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.126782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43546 (local address 127.8.5.252:46795)
0809 03:27:43.126817 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.126819 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.126827 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:27:43.126846 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.126847 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.126856 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.126917 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.127218 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.127864 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.128776 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.129109 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.129169 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:43.130985 (+ 1816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:43.130986 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:43.130986 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:43.130993 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:43.132366 (+ 1373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.132707 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.132708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.132708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.132761 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.133078 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.133079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.133079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.133187 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:43.133261 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:43.133398 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 03:27:43.133503 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":18}
Aug 09 03:27:43 dist-test-slave-2w3w krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.253@KRBTEST.COM
I20260809 03:27:43.135030 32356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854: Bootstrap starting.
I20260809 03:27:43.135977 32356 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:43.136260 32356 log.cc:824] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:43.137167 32356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854: No bootstrap required, opened a new log
I20260809 03:27:43.137393 32281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.130258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34220 (local address 127.8.5.253:38623)
0809 03:27:43.130301 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.130303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.130312 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:27:43.130385 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.130386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.130396 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.130443 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.130943 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.131581 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.132241 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.132462 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.132538 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:43.134644 (+ 2106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:43.134645 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:43.134646 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:43.134653 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:43.136181 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.136601 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.136602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.136602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.136654 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.136882 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.136883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.136884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.137016 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:43.137189 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:43.137231 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 03:27:43.137314 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:27:43.138893 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:43.139246 32356 raft_consensus.cc:348] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } } peers { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } } peers { permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } }
I20260809 03:27:43.139372 32356 raft_consensus.cc:729] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 432f6351fbcd4052b50f86455945b854, State: Initialized, Role: FOLLOWER
I20260809 03:27:43.139454 32356 consensus_queue.cc:260] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } } peers { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } } peers { permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } }
I20260809 03:27:43.139551 32198 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } attempt: 2
I20260809 03:27:43.139781 32356 sys_catalog.cc:564] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:43.139755 32363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } } peers { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } } peers { permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } } }
I20260809 03:27:43.139976 32363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:27:43.140065 32170 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52496
W20260809 03:27:43.141666 32375 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:27:43.141726 32375 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 09 03:27:43 dist-test-slave-2w3w krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246062, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for kudu/127.8.5.252@KRBTEST.COM
I20260809 03:27:43.141880 32284 master_runner.cc:186] Error getting master registration for 127.8.5.254:38823: OK, instance_id { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" instance_seqno: 1786246062789739 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 03:27:43.144495 32284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 03:27:43.147300 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.139793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:46795 (local address 127.0.0.1:43560)
0809 03:27:43.139879 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:43.139890 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:43.139927 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:43.140074 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:43.140075 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:43.140235 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:43.140282 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:43.140284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.141128 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.141129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:43.141888 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:43.141891 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.142326 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.142327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:43.142390 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:43.142805 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:43.142810 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:43.144391 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:43.146069 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:43.146070 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:43.146071 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:43.146302 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:43.146486 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:43.146487 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:43.146487 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:43.146572 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:43.146921 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:43.146922 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:43.147021 (+ 99us) client_negotiation.cc:769] Sending connection context
0809 03:27:43.147102 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 03:27:43.147201 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 03:27:43.147305 32361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.139893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43560 (local address 127.8.5.252:46795)
0809 03:27:43.139928 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.139929 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.139937 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:27:43.139981 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.139982 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.139992 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.140353 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.140383 (+ 30us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.141051 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.141968 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.142237 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.142308 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:43.144502 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:43.144503 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:43.144504 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:43.144511 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:43.145998 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.146380 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.146381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.146381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.146429 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.146621 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.146622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.146622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.146817 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:43.146903 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:43.147133 (+ 230us) server_negotiation.cc:299] Negotiation successful
0809 03:27:43.147214 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 03:27:43.148546 32198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb: Bootstrap starting.
I20260809 03:27:43.149088 32198 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:43.149313 32198 log.cc:824] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:43.150247 32198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb: No bootstrap required, opened a new log
I20260809 03:27:43.151697 32198 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } } peers { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } } peers { permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } }
I20260809 03:27:43.151850 32198 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5338901b7ec94b6a92ea3ed1b6d4cbfb, State: Initialized, Role: FOLLOWER
I20260809 03:27:43.151945 32198 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } } peers { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } } peers { permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } }
I20260809 03:27:43.152261 32198 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:43.152311 32170 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 03:27:43.152410 32170 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:43.153254 32170 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } } peers { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } } peers { permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } }
I20260809 03:27:43.153546 32170 leader_election.cc:288] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [CANDIDATE]: Term 1 election: Requested vote from peers 621e85ab496b4fe69be8054bd42864ef (127.8.5.253:38623), 432f6351fbcd4052b50f86455945b854 (127.8.5.252:46795)
W20260809 03:27:43.154407 32389 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:27:43.154461 32389 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:27:43.155220 32329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "432f6351fbcd4052b50f86455945b854"
I20260809 03:27:43.155350 32329 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:43.156368 32329 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5338901b7ec94b6a92ea3ed1b6d4cbfb in term 1.
I20260809 03:27:43.156623 32143 leader_election.cc:302] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 432f6351fbcd4052b50f86455945b854, 5338901b7ec94b6a92ea3ed1b6d4cbfb; no voters:
I20260809 03:27:43.152271 32378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } } peers { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } } peers { permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } } }
I20260809 03:27:43.157126 32378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:27:43.157194 32378 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:43.157245 32378 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [term 1 LEADER]: Becoming Leader. State: Replica: 5338901b7ec94b6a92ea3ed1b6d4cbfb, State: Running, Role: LEADER
I20260809 03:27:43.157330 32378 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } } peers { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } } peers { permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } }
I20260809 03:27:43.157801 32378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5338901b7ec94b6a92ea3ed1b6d4cbfb. Latest consensus state: current_term: 1 leader_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } } peers { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } } peers { permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } } }
I20260809 03:27:43.157874 32378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:43.157315 32123 master_runner.cc:186] Error getting master registration for 127.8.5.253:38623: OK, instance_id { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" instance_seqno: 1786246062936033 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 03:27:43.159742 32123 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 03:27:43.164832 32397 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:43.165096 32397 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:43.167841 32329 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854 [term 1 FOLLOWER]: Refusing update from remote peer 5338901b7ec94b6a92ea3ed1b6d4cbfb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:27:43.168202 32395 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:27:43.169045 32281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.159238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34224 (local address 127.8.5.253:38623)
0809 03:27:43.159291 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.159293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.159620 (+ 327us) server_negotiation.cc:407] Connection header received
0809 03:27:43.159686 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.159687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.159701 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.159782 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.160658 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.161175 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.162307 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.162545 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.162631 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:43.164522 (+ 1891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:43.164524 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:43.164524 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:43.164533 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:43.166768 (+ 2235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.167505 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.167507 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.167507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.167578 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.168070 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.168071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.168072 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.168232 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:43.168350 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:43.168847 (+ 497us) server_negotiation.cc:299] Negotiation successful
0809 03:27:43.168949 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 03:27:43.169673 32363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5338901b7ec94b6a92ea3ed1b6d4cbfb. Latest consensus state: current_term: 1 leader_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } } peers { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } } peers { permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } } }
I20260809 03:27:43.169795 32363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:27:43.170022 32276 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } attempt: 3
I20260809 03:27:43.172153 32395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } } peers { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } } peers { permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } } }
I20260809 03:27:43.172273 32395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:43.172737 32363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } } peers { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } } peers { permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } } }
I20260809 03:27:43.172842 32363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:27:43.173105 32402 mvcc.cc:205] Tried to move back new op lower bound from 7316463874732462080 to 7316463874693345280. Current Snapshot: MvccSnapshot[applied={T|T < 7316463874732462080}]
I20260809 03:27:43.174074 32403 mvcc.cc:205] Tried to move back new op lower bound from 7316463874732462080 to 7316463874693345280. Current Snapshot: MvccSnapshot[applied={T|T < 7316463874732462080}]
Aug 09 03:27:43 dist-test-slave-2w3w krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246062, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.253@KRBTEST.COM for kudu/127.8.5.252@KRBTEST.COM
I20260809 03:27:43.181636 32397 catalog_manager.cc:1347] Generated new cluster ID: 2c0b3911cc894d3e8fcead60a9ff33dd
I20260809 03:27:43.181689 32397 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:43.185371 32361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.163275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43570 (local address 127.8.5.252:46795)
0809 03:27:43.163323 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.163325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.170820 (+ 7495us) server_negotiation.cc:407] Connection header received
0809 03:27:43.171021 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.171022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.171035 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.171085 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.172570 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.173335 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.175246 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.175588 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.175633 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:43.178221 (+ 2588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:43.178223 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:43.178223 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:43.178232 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:43.180742 (+ 2510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.183893 (+ 3151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.183895 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.183896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.183969 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.184394 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.184396 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.184396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.184547 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:43.184653 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:43.185131 (+ 478us) server_negotiation.cc:299] Negotiation successful
0809 03:27:43.185251 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 03:27:43.187800 32279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.170238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:46795 (local address 127.0.0.1:43580)
0809 03:27:43.170342 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:43.170354 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:43.170397 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:43.174494 (+ 4097us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:43.174495 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:43.174668 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:43.174710 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:43.174712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.176361 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.176363 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:43.177310 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:43.177313 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.178354 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.178356 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:43.178437 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:43.178888 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:43.178894 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:43.180730 (+ 1836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:43.186515 (+ 5785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:43.186517 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:43.186517 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:43.186754 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:43.187033 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:43.187034 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:43.187034 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:43.187104 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:43.187428 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:43.187429 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:43.187500 (+ 71us) client_negotiation.cc:769] Sending connection context
0809 03:27:43.187573 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 03:27:43.187688 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 03:27:43.188040 32405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.170475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43580 (local address 127.8.5.252:46795)
0809 03:27:43.174277 (+ 3802us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.174279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.174288 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:27:43.174333 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.174334 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.174344 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.174825 (+ 481us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.174887 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.176181 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.177474 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.178211 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.178583 (+ 372us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:43.180857 (+ 2274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:43.180858 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:43.180858 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:43.180865 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:43.186397 (+ 5532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.186815 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.186816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.186817 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.186898 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.187197 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.187198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.187199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.187339 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:43.187398 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:43.187626 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 03:27:43.187779 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3755,"thread_start_us":90,"threads_started":1}
I20260809 03:27:43.189729 32276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef: Bootstrap starting.
I20260809 03:27:43.190531 32276 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:43.190873 32276 log.cc:824] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:43.191843 32276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef: No bootstrap required, opened a new log
I20260809 03:27:43.194118 32276 raft_consensus.cc:348] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } } peers { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } } peers { permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } }
I20260809 03:27:43.194272 32276 raft_consensus.cc:729] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 621e85ab496b4fe69be8054bd42864ef, State: Initialized, Role: FOLLOWER
I20260809 03:27:43.194381 32276 consensus_queue.cc:260] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } } peers { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } } peers { permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } }
I20260809 03:27:43.194810 32276 sys_catalog.cc:564] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:43.194861 32249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "621e85ab496b4fe69be8054bd42864ef"
I20260809 03:27:43.194991 32249 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:43.196040 32249 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5338901b7ec94b6a92ea3ed1b6d4cbfb in term 1.
I20260809 03:27:43.194785 32409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } } peers { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } } peers { permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } } }
I20260809 03:27:43.196764 32409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:27:43.196297 32248 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef [term 1 FOLLOWER]: Refusing update from remote peer 5338901b7ec94b6a92ea3ed1b6d4cbfb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:27:43.197304 32378 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 03:27:43.197873 32420 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:27:43.197927 32420 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:27:43.198907 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:43.163180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52510 (local address 127.8.5.254:38823)
0809 03:27:43.163221 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.163223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.167136 (+ 3913us) server_negotiation.cc:407] Connection header received
0809 03:27:43.167233 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.167234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.167244 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.167273 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.167931 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.168673 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.179045 (+ 10372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:43.179358 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:43.179402 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:43.180959 (+ 1557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:43.180960 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:43.180960 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:43.180969 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:43.183457 (+ 2488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.191378 (+ 7921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.191380 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.191381 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.191475 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:43.198260 (+ 6785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:43.198261 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:43.198262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:43.198410 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:43.198497 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:43.198708 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 03:27:43.198800 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:27:43.200567 32409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5338901b7ec94b6a92ea3ed1b6d4cbfb. Latest consensus state: current_term: 1 leader_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } } peers { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } } peers { permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } } }
I20260809 03:27:43.200721 32409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:27:43.200814 32409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } } peers { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } } peers { permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } } }
I20260809 03:27:43.200930 32409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:27:43.202148 32422 mvcc.cc:205] Tried to move back new op lower bound from 7316463874732462080 to 7316463874693345280. Current Snapshot: MvccSnapshot[applied={T|T < 7316463874732462080}]
I20260809 03:27:43.234766 32378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5338901b7ec94b6a92ea3ed1b6d4cbfb" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 38823 } } peers { permanent_uuid: "621e85ab496b4fe69be8054bd42864ef" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 38623 } } peers { permanent_uuid: "432f6351fbcd4052b50f86455945b854" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 46795 } } }
I20260809 03:27:43.234903 32378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:43.243073 32397 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:43.244055 32397 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:43.253135 32397 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5338901b7ec94b6a92ea3ed1b6d4cbfb: Generated new TSK 0
I20260809 03:27:43.253525 32397 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 03:27:43.281100 32405 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:43.279360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43588 (local address 127.8.5.252:46795)
0809 03:27:43.279414 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.279417 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.280396 (+ 979us) server_negotiation.cc:407] Connection header received
0809 03:27:43.280515 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.280516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.280529 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.280564 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.281029 (+ 465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43588: BlockingRecv error: recv got EOF from 127.0.0.1:43588 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260809 03:27:43.282092 32201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:43.279723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52518 (local address 127.8.5.254:38823)
0809 03:27:43.279764 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.279766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.281548 (+ 1782us) server_negotiation.cc:407] Connection header received
0809 03:27:43.281655 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.281656 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.281667 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.281701 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.282027 (+ 326us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52518: BlockingRecv error: recv got EOF from 127.0.0.1:52518 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260809 03:27:43.283169 32281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:43.280066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34230 (local address 127.8.5.253:38623)
0809 03:27:43.280107 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.280109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.282448 (+ 2339us) server_negotiation.cc:407] Connection header received
0809 03:27:43.282649 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.282650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.282662 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.282694 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.283100 (+ 406us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34230: BlockingRecv error: recv got EOF from 127.0.0.1:34230 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 03:27:43.285840 32281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:43.285043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34234 (local address 127.8.5.253:38623)
0809 03:27:43.285080 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.285082 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.285300 (+ 218us) server_negotiation.cc:407] Connection header received
0809 03:27:43.285415 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.285417 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.285434 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.285466 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.285794 (+ 328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34234: BlockingRecv error: recv got EOF from 127.0.0.1:34234 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260809 03:27:43.289165 32281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:43.288337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34236 (local address 127.8.5.253:38623)
0809 03:27:43.288371 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.288373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.288665 (+ 292us) server_negotiation.cc:407] Connection header received
0809 03:27:43.288766 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.288767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.288778 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.288809 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.289118 (+ 309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34236: BlockingRecv error: recv got EOF from 127.0.0.1:34236 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 03:27:43.293322 32281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:43.292468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34248 (local address 127.8.5.253:38623)
0809 03:27:43.292503 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.292504 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.292748 (+ 244us) server_negotiation.cc:407] Connection header received
0809 03:27:43.292853 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.292854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.292867 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.292926 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.293276 (+ 350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34248: BlockingRecv error: recv got EOF from 127.0.0.1:34248 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 03:27:43.299604 32281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:43.298687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34250 (local address 127.8.5.253:38623)
0809 03:27:43.298726 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.298728 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.299021 (+ 293us) server_negotiation.cc:407] Connection header received
0809 03:27:43.299135 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.299137 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.299148 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.299180 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.299554 (+ 374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34250: BlockingRecv error: recv got EOF from 127.0.0.1:34250 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260809 03:27:43.310012 32281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:43.309055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34252 (local address 127.8.5.253:38623)
0809 03:27:43.309095 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.309097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.309423 (+ 326us) server_negotiation.cc:407] Connection header received
0809 03:27:43.309534 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.309535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.309547 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.309580 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.309957 (+ 377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34252: BlockingRecv error: recv got EOF from 127.0.0.1:34252 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 03:27:43.328725 32281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:43.327684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34258 (local address 127.8.5.253:38623)
0809 03:27:43.327732 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.327734 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.328050 (+ 316us) server_negotiation.cc:407] Connection header received
0809 03:27:43.328170 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.328171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.328184 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.328217 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.328658 (+ 441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34258: BlockingRecv error: recv got EOF from 127.0.0.1:34258 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260809 03:27:43.363101 32281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:43.362373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34262 (local address 127.8.5.253:38623)
0809 03:27:43.362425 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.362427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.362530 (+ 103us) server_negotiation.cc:407] Connection header received
0809 03:27:43.362571 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.362572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.362585 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.362676 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.363032 (+ 356us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34262: BlockingRecv error: recv got EOF from 127.0.0.1:34262 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260809 03:27:43.429322 32281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:43.428578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34276 (local address 127.8.5.253:38623)
0809 03:27:43.428651 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.428654 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.428771 (+ 117us) server_negotiation.cc:407] Connection header received
0809 03:27:43.428844 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.428845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.428855 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.428909 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.429248 (+ 339us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34276: BlockingRecv error: recv got EOF from 127.0.0.1:34276 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 03:27:43.559412 32281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:43.558502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34288 (local address 127.8.5.253:38623)
0809 03:27:43.558604 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.558606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.558714 (+ 108us) server_negotiation.cc:407] Connection header received
0809 03:27:43.558839 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.558840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.558859 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.558925 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.559328 (+ 403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34288: BlockingRecv error: recv got EOF from 127.0.0.1:34288 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260809 03:27:43.817291 32281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:43.816705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34302 (local address 127.8.5.253:38623)
0809 03:27:43.816779 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:43.816781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:43.816790 (+ 9us) server_negotiation.cc:407] Connection header received
0809 03:27:43.816815 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:43.816816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:43.816827 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:43.816892 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:43.817209 (+ 317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34302: BlockingRecv error: recv got EOF from 127.0.0.1:34302 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 03:27:44.142205 32375 catalog_manager.cc:1259] Loaded cluster ID: 2c0b3911cc894d3e8fcead60a9ff33dd
I20260809 03:27:44.142287 32375 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854: loading cluster ID for follower catalog manager: success
I20260809 03:27:44.143085 32375 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854: acquiring CA information for follower catalog manager: success
I20260809 03:27:44.143347 32375 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 432f6351fbcd4052b50f86455945b854: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 03:27:44.198376 32420 catalog_manager.cc:1259] Loaded cluster ID: 2c0b3911cc894d3e8fcead60a9ff33dd
I20260809 03:27:44.198454 32420 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef: loading cluster ID for follower catalog manager: success
I20260809 03:27:44.199347 32420 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef: acquiring CA information for follower catalog manager: success
I20260809 03:27:44.199692 32420 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 621e85ab496b4fe69be8054bd42864ef: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 03:27:44.333098 32496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:44.330622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34308 (local address 127.8.5.253:38623)
0809 03:27:44.330732 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:44.330733 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:44.330747 (+ 14us) server_negotiation.cc:407] Connection header received
0809 03:27:44.330830 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:44.330831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:44.330889 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:44.331027 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:27:44.331142 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:44.331636 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:44.332370 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:44.332558 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:44.332608 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:44.332750 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:27:44.332862 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:27:44.332920 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:44.332960 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 03:27:44.332977 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":61,"threads_started":1}
I20260809 03:27:44.337236 32503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:44.335092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43598 (local address 127.8.5.252:46795)
0809 03:27:44.335199 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:44.335200 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:44.335238 (+ 38us) server_negotiation.cc:407] Connection header received
0809 03:27:44.335304 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:44.335305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:44.335344 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:44.335407 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:27:44.335503 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:44.335969 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:44.336616 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:44.336795 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:44.336864 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:44.336976 (+ 112us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:27:44.337062 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:27:44.337115 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:44.337163 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 03:27:44.337178 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":66,"threads_started":1}
I20260809 03:27:44.342000 32510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:44.338897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52524 (local address 127.8.5.254:38823)
0809 03:27:44.339079 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:44.339081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:44.339157 (+ 76us) server_negotiation.cc:407] Connection header received
0809 03:27:44.339283 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:44.339284 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:44.339339 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:44.339411 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:27:44.339581 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:44.340088 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:44.341016 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:44.341337 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:44.341408 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:44.341602 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:27:44.341711 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:27:44.341769 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:44.341884 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 03:27:44.341913 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":75,"threads_started":1}
I20260809 03:27:44.342020 32496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:44.339011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34320 (local address 127.8.5.253:38623)
0809 03:27:44.339049 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:44.339051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:44.339059 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:27:44.339085 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:44.339086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:44.339098 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:44.339160 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:27:44.339266 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:44.340021 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:44.341135 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:44.341443 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:44.341496 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:44.341755 (+ 259us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:27:44.341794 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:27:44.341857 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:44.341909 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 03:27:44.341933 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 03:27:44.342371 32503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:44.338907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43604 (local address 127.8.5.252:46795)
0809 03:27:44.338953 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:44.338971 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:44.339286 (+ 315us) server_negotiation.cc:407] Connection header received
0809 03:27:44.339310 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:44.339311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:44.339321 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:44.339371 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:27:44.339513 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:44.340193 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:44.341262 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:44.341543 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:44.341597 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:44.341763 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:27:44.341795 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:27:44.341841 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:44.342251 (+ 410us) server_negotiation.cc:299] Negotiation successful
0809 03:27:44.342272 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 03:27:44.344175 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 32123
I20260809 03:27:44.351591 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 32205
I20260809 03:27:44.357605 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 32284
2026-08-09T03:27:44Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2894 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 03:27:44 dist-test-slave-2w3w krb5kdc[32514](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 03:27:44 dist-test-slave-2w3w krb5kdc[32514](info): set up 2 sockets
Aug 09 03:27:44 dist-test-slave-2w3w krb5kdc[32514](info): commencing operation
krb5kdc: starting...
W20260809 03:27:45.443293 8215 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/test-user.keytab.
Aug 09 03:27:45 dist-test-slave-2w3w krb5kdc[32514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T03:27:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T03:27:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.5.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
Entry for principal kudu/127.8.5.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab.
I20260809 03:27:45.570305 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:43761
--webserver_interface=127.8.5.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:37487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:43761,127.8.5.253:35077,127.8.5.252:35065
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 03:27:45.652582 32527 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 03:27:45.652796 32527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:45.652813 32527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:45.652833 32527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:45.653975 32527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:45.654018 32527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:45.654033 32527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:45.654045 32527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:45.654099 32527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:45.655627 32527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:37487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:43761,127.8.5.253:35077,127.8.5.252:35065
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.254.keytab
--principal=kudu/127.8.5.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.254:43761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.5.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:45.655879 32527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:45.656143 32527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:45.661100 32538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:45.661121 32534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:45.661110 32535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:45.661309 32527 server_base.cc:1034] running on GCE node
I20260809 03:27:45.661547 32527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:45.661865 32527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:45.663023 32527 hybrid_clock.cc:648] HybridClock initialized: now 1786246065663011 us; error 27 us; skew 500 ppm
Aug 09 03:27:45 dist-test-slave-2w3w krb5kdc[32514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246065, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:45.665784 32527 init.cc:377] Logged in from keytab as kudu/127.8.5.254@KRBTEST.COM (short username kudu)
I20260809 03:27:45.666265 32527 webserver.cc:460] Webserver started at http://127.8.5.254:40667/ using document root <none> and password file <none>
I20260809 03:27:45.666527 32527 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:45.666596 32527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:45.666747 32527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:45.667873 32527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-0/data/instance:
uuid: "5ddb44541d614d82af5450344f2ad2ee"
format_stamp: "Formatted at 2026-08-09 03:27:45 on dist-test-slave-2w3w"
server_key: "91e413b41356186d1fac06fc9afcf65d"
server_key_iv: "fad9ace88ee8992c1a7d9d5f91859120"
server_key_version: "encryptionkey@0"
I20260809 03:27:45.668237 32527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-0/wal/instance:
uuid: "5ddb44541d614d82af5450344f2ad2ee"
format_stamp: "Formatted at 2026-08-09 03:27:45 on dist-test-slave-2w3w"
server_key: "91e413b41356186d1fac06fc9afcf65d"
server_key_iv: "fad9ace88ee8992c1a7d9d5f91859120"
server_key_version: "encryptionkey@0"
I20260809 03:27:45.669610 32527 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:27:45.670562 32547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:45.670784 32527 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:45.670858 32527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-0/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-0/wal
uuid: "5ddb44541d614d82af5450344f2ad2ee"
format_stamp: "Formatted at 2026-08-09 03:27:45 on dist-test-slave-2w3w"
server_key: "91e413b41356186d1fac06fc9afcf65d"
server_key_iv: "fad9ace88ee8992c1a7d9d5f91859120"
server_key_version: "encryptionkey@0"
I20260809 03:27:45.670945 32527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:45.715445 32527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:45.717911 32527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:45.718080 32527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:45.722381 32527 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.254:43761
I20260809 03:27:45.722445 32605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.254:43761 every 8 connection(s)
I20260809 03:27:45.722810 32527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-0/data/info.pb
I20260809 03:27:45.723884 32606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:45.725524 32606 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:27:45.725973 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 32527
I20260809 03:27:45.726095 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-0/wal/instance
I20260809 03:27:45.726334 8215 external_mini_cluster.cc:1428] Setting key bbce399e397c324735862cd6b0d6dc77
Aug 09 03:27:45 dist-test-slave-2w3w krb5kdc[32514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246065, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.5.253@KRBTEST.COM; defaulting to no policy
I20260809 03:27:45.735874 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.726362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52024 (local address 127.8.5.254:43761)
0809 03:27:45.726528 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:45.726538 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:45.726703 (+ 165us) server_negotiation.cc:407] Connection header received
0809 03:27:45.727271 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:45.727274 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:45.727298 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:45.727427 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:45.727988 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:45.728959 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:45.729919 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:45.730219 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:45.730360 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:45.732534 (+ 2174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:45.732540 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:45.732541 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:45.732547 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:45.734260 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:45.734654 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:45.734656 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:45.734656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:45.734728 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:45.734988 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:45.734988 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:45.734989 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:45.735202 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:45.735298 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:45.735492 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 03:27:45.735625 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":81,"threads_started":1}
I20260809 03:27:45.735877 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.726301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:43761 (local address 127.0.0.1:52024)
0809 03:27:45.726540 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:45.726577 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:45.727117 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:45.727443 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:45.727446 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:45.727713 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:45.727888 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:45.727891 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:45.729062 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:45.729063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:45.729845 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:45.729847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:45.730327 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:45.730328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:45.730393 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:45.731032 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:45.731049 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:45.732437 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:45.734351 (+ 1914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:45.734357 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:45.734359 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:45.734556 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:45.734813 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:45.734814 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:45.734815 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:45.734905 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:45.735276 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:45.735281 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:45.735351 (+ 70us) client_negotiation.cc:769] Sending connection context
0809 03:27:45.735454 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 03:27:45.735692 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":96,"thread_start_us":91,"threads_started":1}
I20260809 03:27:45.736680 32606 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:27:45.737159 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.737026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:35077 (local address 127.0.0.1:50744)
0809 03:27:45.737080 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:45.737125 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.253:35077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 03:27:45.737314 32548 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.5.253:35077: connect: Connection refused (error 111)
I20260809 03:27:45.737733 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.737598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:35077 (local address 127.0.0.1:50750)
0809 03:27:45.737652 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:45.737710 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.253:35077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260809 03:27:45.737891 32606 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.253:35077: Network error: Client connection negotiation failed: client connection to 127.8.5.253:35077: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.253.keytab.
Entry for principal kudu/127.8.5.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.253.keytab.
I20260809 03:27:45.753803 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.253:35077
--webserver_interface=127.8.5.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.253.keytab
--principal=kudu/127.8.5.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:37487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:43761,127.8.5.253:35077,127.8.5.252:35065
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 03:27:45.787096 32606 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } attempt: 1
I20260809 03:27:45.787648 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.787506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:35077 (local address 127.0.0.1:50754)
0809 03:27:45.787573 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:45.787618 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.253:35077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 03:27:45.788040 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.787928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:35077 (local address 127.0.0.1:50760)
0809 03:27:45.787981 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:45.788007 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.253:35077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 03:27:45.788156 32606 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.253:35077: Network error: Client connection negotiation failed: client connection to 127.8.5.253:35077: connect: Connection refused (error 111)
W20260809 03:27:45.837195 32613 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 03:27:45.837437 32613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:45.837466 32613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:45.837507 32613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:45.838647 32613 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:45.838706 32613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:45.838729 32613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:45.838749 32613 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:45.838790 32613 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:45.840296 32613 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:37487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:43761,127.8.5.253:35077,127.8.5.252:35065
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.253.keytab
--principal=kudu/127.8.5.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.253:35077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.5.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:45.840564 32613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:45.840790 32613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:45.845597 32618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:45.845685 32619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:45.845597 32621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:45.845834 32613 server_base.cc:1034] running on GCE node
I20260809 03:27:45.846050 32613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:45.846278 32613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:45.847419 32613 hybrid_clock.cc:648] HybridClock initialized: now 1786246065847404 us; error 33 us; skew 500 ppm
Aug 09 03:27:45 dist-test-slave-2w3w krb5kdc[32514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246065, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:45.849792 32613 init.cc:377] Logged in from keytab as kudu/127.8.5.253@KRBTEST.COM (short username kudu)
I20260809 03:27:45.850148 32613 webserver.cc:460] Webserver started at http://127.8.5.253:35995/ using document root <none> and password file <none>
I20260809 03:27:45.850314 32613 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:45.850353 32613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:45.850446 32613 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:45.851498 32613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-1/data/instance:
uuid: "412fd357893946319941ae72d655cb65"
format_stamp: "Formatted at 2026-08-09 03:27:45 on dist-test-slave-2w3w"
server_key: "973f2d9600a8c6035f13fa8090d9ef0e"
server_key_iv: "66c5e91048220bf080513c61812ec05f"
server_key_version: "encryptionkey@0"
I20260809 03:27:45.851802 32613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-1/wal/instance:
uuid: "412fd357893946319941ae72d655cb65"
format_stamp: "Formatted at 2026-08-09 03:27:45 on dist-test-slave-2w3w"
server_key: "973f2d9600a8c6035f13fa8090d9ef0e"
server_key_iv: "66c5e91048220bf080513c61812ec05f"
server_key_version: "encryptionkey@0"
I20260809 03:27:45.853086 32613 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 03:27:45.853816 32628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:45.854010 32613 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 03:27:45.854110 32613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-1/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-1/wal
uuid: "412fd357893946319941ae72d655cb65"
format_stamp: "Formatted at 2026-08-09 03:27:45 on dist-test-slave-2w3w"
server_key: "973f2d9600a8c6035f13fa8090d9ef0e"
server_key_iv: "66c5e91048220bf080513c61812ec05f"
server_key_version: "encryptionkey@0"
I20260809 03:27:45.854190 32613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:45.856308 32606 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } attempt: 2
I20260809 03:27:45.856734 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.856589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:35077 (local address 127.0.0.1:50766)
0809 03:27:45.856657 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:45.856697 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.253:35077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 03:27:45.857129 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.857024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:35077 (local address 127.0.0.1:50778)
0809 03:27:45.857078 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:45.857106 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.253:35077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 03:27:45.857268 32606 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.253:35077: Network error: Client connection negotiation failed: client connection to 127.8.5.253:35077: connect: Connection refused (error 111)
I20260809 03:27:45.873003 32613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:45.875296 32613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:45.875468 32613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:45.879441 32613 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.253:35077
I20260809 03:27:45.879492 32685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.253:35077 every 8 connection(s)
I20260809 03:27:45.879868 32613 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-1/data/info.pb
I20260809 03:27:45.880820 32686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:45.882405 32686 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 03:27:45 dist-test-slave-2w3w krb5kdc[32514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246065, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.253@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:45.889227 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 32613
I20260809 03:27:45.889343 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-1/wal/instance
I20260809 03:27:45.889562 8215 external_mini_cluster.cc:1428] Setting key bd1507bc2a82ec297539d0aabaf3c524
I20260809 03:27:45.891852 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.883176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52040 (local address 127.8.5.254:43761)
0809 03:27:45.883246 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:45.883248 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:45.883448 (+ 200us) server_negotiation.cc:407] Connection header received
0809 03:27:45.883976 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:45.883977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:45.883990 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:45.884049 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:45.884660 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:45.885166 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:45.886168 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:45.886404 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:45.886494 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:45.888682 (+ 2188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:45.888684 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:45.888684 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:45.888691 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:45.890399 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:45.890786 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:45.890787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:45.890787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:45.890852 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:45.891141 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:45.891143 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:45.891143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:45.891298 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:45.891372 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:45.891720 (+ 348us) server_negotiation.cc:299] Negotiation successful
0809 03:27:45.891787 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 03:27:45.892141 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.883164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:43761 (local address 127.0.0.1:52040)
0809 03:27:45.883322 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:45.883357 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:45.883862 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:45.884120 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:45.884123 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:45.884365 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:45.884557 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:45.884561 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:45.885262 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:45.885263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:45.886072 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:45.886075 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:45.886519 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:45.886520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:45.886664 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:45.887225 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:45.887234 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:45.888598 (+ 1364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:45.890492 (+ 1894us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:45.890499 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:45.890501 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:45.890715 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:45.890919 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:45.890919 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:45.890920 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:45.891075 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:45.891386 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:45.891393 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:45.891576 (+ 183us) client_negotiation.cc:769] Sending connection context
0809 03:27:45.891697 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 03:27:45.891876 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":75,"threads_started":1}
I20260809 03:27:45.892793 32686 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 03:27:45 dist-test-slave-2w3w krb5kdc[32514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246065, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.253@KRBTEST.COM for kudu/127.8.5.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.5.252@KRBTEST.COM; defaulting to no policy
I20260809 03:27:45.899991 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.893064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:35077 (local address 127.0.0.1:50794)
0809 03:27:45.893116 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:45.893126 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:45.893174 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:45.893408 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:45.893409 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:45.893548 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:45.893589 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:45.893591 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:45.894527 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:45.894528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:45.895128 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:45.895129 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:45.895620 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:45.895621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:45.895686 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:45.896114 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:45.896118 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:45.897220 (+ 1102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:45.898891 (+ 1671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:45.898892 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:45.898892 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:45.899144 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:45.899352 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:45.899353 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:45.899353 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:45.899414 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:45.899694 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:45.899695 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:45.899732 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 03:27:45.899797 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 03:27:45.899894 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 03:27:45.900147 32691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.893107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50794 (local address 127.8.5.253:35077)
0809 03:27:45.893264 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:45.893268 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:45.893288 (+ 20us) server_negotiation.cc:407] Connection header received
0809 03:27:45.893313 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:45.893315 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:45.893325 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:45.893407 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:45.893673 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:45.894448 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:45.895217 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:45.895532 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:45.895622 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:45.897303 (+ 1681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:45.897311 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:45.897311 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:45.897318 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:45.898796 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:45.899224 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:45.899227 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:45.899227 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:45.899284 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:45.899485 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:45.899486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:45.899486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:45.899622 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:45.899715 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:45.899824 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 03:27:45.899997 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":131,"thread_start_us":84,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.5.252@KRBTEST.COM" created.
I20260809 03:27:45.900715 32686 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:27:45.901075 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.900949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:35065 (local address 127.0.0.1:60888)
0809 03:27:45.900981 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:45.901046 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:35065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260809 03:27:45.901229 32629 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.5.252:35065: connect: Connection refused (error 111)
I20260809 03:27:45.901707 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.901595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:35065 (local address 127.0.0.1:60890)
0809 03:27:45.901643 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:45.901676 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:35065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 03:27:45.901880 32686 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.252:35065: Network error: Client connection negotiation failed: client connection to 127.8.5.252:35065: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.5.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.252.keytab.
Entry for principal kudu/127.8.5.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.252.keytab.
I20260809 03:27:45.914561 8215 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdTui8C/build/release/bin/kudu
/tmp/dist-test-taskdTui8C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.252:35065
--webserver_interface=127.8.5.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.252.keytab
--principal=kudu/127.8.5.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.5.212:37487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.5.254:43761,127.8.5.253:35077,127.8.5.252:35065
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 03:27:45.948462 32606 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } attempt: 3
I20260809 03:27:45.951115 32686 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } attempt: 1
I20260809 03:27:45.951524 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.951371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:35065 (local address 127.0.0.1:60904)
0809 03:27:45.951426 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:45.951484 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:35065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 03:27:45.952001 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.951753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:35065 (local address 127.0.0.1:60910)
0809 03:27:45.951938 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:45.951966 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:35065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":127,"threads_started":1}
W20260809 03:27:45.952112 32686 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.252:35065: Network error: Client connection negotiation failed: client connection to 127.8.5.252:35065: connect: Connection refused (error 111)
Aug 09 03:27:45 dist-test-slave-2w3w krb5kdc[32514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246065, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for kudu/127.8.5.253@KRBTEST.COM
I20260809 03:27:45.956243 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.948856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:35077 (local address 127.0.0.1:50800)
0809 03:27:45.948957 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:45.948968 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:45.949020 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:45.949174 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:45.949175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:45.949321 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:45.949389 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:45.949390 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:45.950359 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:45.950360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:45.950910 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:45.950912 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:45.951509 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:45.951511 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:45.951602 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:45.952102 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:45.952107 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:45.953566 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:45.955329 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:45.955330 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:45.955330 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:45.955492 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:45.955689 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:45.955689 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:45.955689 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:45.955739 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:45.956010 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:45.956011 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:45.956049 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 03:27:45.956108 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 03:27:45.956180 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 03:27:45.956306 32691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.948937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50800 (local address 127.8.5.253:35077)
0809 03:27:45.949005 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:45.949008 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:45.949021 (+ 13us) server_negotiation.cc:407] Connection header received
0809 03:27:45.949070 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:45.949071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:45.949084 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:45.949160 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:45.949477 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:45.950254 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:45.951001 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:45.951407 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:45.951488 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:45.953655 (+ 2167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:45.953657 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:45.953657 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:45.953665 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:45.955234 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:45.955559 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:45.955560 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:45.955561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:45.955625 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:45.955797 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:45.955798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:45.955799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:45.955950 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:45.956016 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:45.956146 (+ 130us) server_negotiation.cc:299] Negotiation successful
0809 03:27:45.956224 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 03:27:45.956712 32606 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:27:45.957056 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.956934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:35065 (local address 127.0.0.1:60918)
0809 03:27:45.956982 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:45.957029 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:35065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 03:27:45.957394 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.957296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:35065 (local address 127.0.0.1:60922)
0809 03:27:45.957350 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:45.957374 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:35065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 03:27:45.957486 32606 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.252:35065: Network error: Client connection negotiation failed: client connection to 127.8.5.252:35065: connect: Connection refused (error 111)
I20260809 03:27:45.988667 32606 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } attempt: 1
I20260809 03:27:45.989105 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.988967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:35065 (local address 127.0.0.1:60938)
0809 03:27:45.989039 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:45.989077 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:35065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 03:27:45.989491 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:45.989400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:35065 (local address 127.0.0.1:60942)
0809 03:27:45.989443 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:45.989468 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:35065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 03:27:45.989578 32606 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.252:35065: Network error: Client connection negotiation failed: client connection to 127.8.5.252:35065: connect: Connection refused (error 111)
W20260809 03:27:45.998286 32694 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 03:27:45.998494 32694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 03:27:45.998512 32694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 03:27:45.998533 32694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 03:27:45.999984 32694 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 03:27:46.000053 32694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 03:27:46.000077 32694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 03:27:46.000098 32694 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 03:27:46.000126 32694 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 03:27:46.001768 32694 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.5.212:37487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.5.254:43761,127.8.5.253:35077,127.8.5.252:35065
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/krb5kdc/kudu_127.8.5.252.keytab
--principal=kudu/127.8.5.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.5.252:35065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.5.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 02:27:49 UTC on ccycloud.quasar-uxsfuz.root.comops.site
build id 4575768
I20260809 03:27:46.002051 32694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 03:27:46.002306 32694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 03:27:46.007263 32700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:46.007328 32694 server_base.cc:1034] running on GCE node
W20260809 03:27:46.007416 32701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 03:27:46.007264 32703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 03:27:46.007786 32694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 03:27:46.008088 32694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 03:27:46.009230 32694 hybrid_clock.cc:648] HybridClock initialized: now 1786246066009208 us; error 38 us; skew 500 ppm
Aug 09 03:27:46 dist-test-slave-2w3w krb5kdc[32514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246066, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 03:27:46.011736 32694 init.cc:377] Logged in from keytab as kudu/127.8.5.252@KRBTEST.COM (short username kudu)
I20260809 03:27:46.012230 32694 webserver.cc:460] Webserver started at http://127.8.5.252:39879/ using document root <none> and password file <none>
I20260809 03:27:46.012480 32694 fs_manager.cc:359] Metadata directory not provided
I20260809 03:27:46.012555 32694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 03:27:46.012705 32694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 03:27:46.013758 32694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-2/data/instance:
uuid: "8ce6faacaf43407fa82e7b89313ab133"
format_stamp: "Formatted at 2026-08-09 03:27:46 on dist-test-slave-2w3w"
server_key: "eb70af80fbc8def5bf82db1e5392a055"
server_key_iv: "ebf2ac72eb82096ed143c70290397129"
server_key_version: "encryptionkey@0"
I20260809 03:27:46.014128 32694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-2/wal/instance:
uuid: "8ce6faacaf43407fa82e7b89313ab133"
format_stamp: "Formatted at 2026-08-09 03:27:46 on dist-test-slave-2w3w"
server_key: "eb70af80fbc8def5bf82db1e5392a055"
server_key_iv: "ebf2ac72eb82096ed143c70290397129"
server_key_version: "encryptionkey@0"
I20260809 03:27:46.015563 32694 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 03:27:46.016323 32710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 03:27:46.016494 32694 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 03:27:46.016600 32694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-2/data,/tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-2/wal
uuid: "8ce6faacaf43407fa82e7b89313ab133"
format_stamp: "Formatted at 2026-08-09 03:27:46 on dist-test-slave-2w3w"
server_key: "eb70af80fbc8def5bf82db1e5392a055"
server_key_iv: "ebf2ac72eb82096ed143c70290397129"
server_key_version: "encryptionkey@0"
I20260809 03:27:46.016675 32694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 03:27:46.020294 32686 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } attempt: 2
I20260809 03:27:46.020706 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:46.020569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:35065 (local address 127.0.0.1:60956)
0809 03:27:46.020631 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:46.020671 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:35065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 03:27:46.021142 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:46.021027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:35065 (local address 127.0.0.1:60960)
0809 03:27:46.021076 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:46.021108 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.5.252:35065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 03:27:46.021224 32686 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.5.252:35065: Network error: Client connection negotiation failed: client connection to 127.8.5.252:35065: connect: Connection refused (error 111)
I20260809 03:27:46.031955 32694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 03:27:46.033735 32694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 03:27:46.033906 32694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 03:27:46.037997 32694 rpc_server.cc:307] RPC server started. Bound to: 127.8.5.252:35065
I20260809 03:27:46.038028 32765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.5.252:35065 every 8 connection(s)
I20260809 03:27:46.038394 32694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-2/data/info.pb
I20260809 03:27:46.039456 8215 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdTui8C/build/release/bin/kudu as pid 32694
I20260809 03:27:46.039583 8215 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdTui8C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786245797426041-8215-0/minicluster-data/master-2/wal/instance
I20260809 03:27:46.039587 32766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 03:27:46.039801 8215 external_mini_cluster.cc:1428] Setting key c15a85aad1e2f4df95a8f13479b88a7f
I20260809 03:27:46.042255 32766 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 03:27:46 dist-test-slave-2w3w krb5kdc[32514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.252@KRBTEST.COM
Aug 09 03:27:46 dist-test-slave-2w3w krb5kdc[32514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246066, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.252@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:46.051656 302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:46.040297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60968 (local address 127.8.5.252:35065)
0809 03:27:46.040630 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.040640 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.040673 (+ 33us) server_negotiation.cc:407] Connection header received
0809 03:27:46.041278 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.041288 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.041353 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.041496 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.042370 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.043917 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.044787 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.045193 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.045310 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:46.047990 (+ 2680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:46.047997 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:46.047997 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:46.048003 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:46.050034 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.050392 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.050395 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.050396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.050501 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.050697 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.050698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.050698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.051041 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:46.051201 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:46.051309 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 03:27:46.051435 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":96,"threads_started":1}
I20260809 03:27:46.052146 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:46.043072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52044 (local address 127.8.5.254:43761)
0809 03:27:46.043114 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.043116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.043577 (+ 461us) server_negotiation.cc:407] Connection header received
0809 03:27:46.043765 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.043766 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.043779 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.043851 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.044317 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.044878 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.045712 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.046030 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.046110 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:46.048641 (+ 2531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:46.048642 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:46.048643 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:46.048652 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:46.050932 (+ 2280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.051316 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.051318 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.051318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.051384 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.051579 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.051580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.051580 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.051695 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:46.051772 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:46.051970 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 03:27:46.052058 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 03:27:46.052157 303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:46.043147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.254:43761 (local address 127.0.0.1:52044)
0809 03:27:46.043456 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:46.043494 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:46.043599 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:46.043898 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:46.043901 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:46.044159 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:46.044224 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:46.044226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.044962 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.044963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:46.045598 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:46.045600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.046143 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.046144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:46.046197 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:46.046676 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:46.046684 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:46.048560 (+ 1876us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:46.051037 (+ 2477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:46.051044 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:46.051045 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:46.051229 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:46.051454 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:46.051455 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:46.051455 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:46.051514 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:46.051797 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:46.051807 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:46.051852 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 03:27:46.051941 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 03:27:46.052051 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":85,"threads_started":1}
I20260809 03:27:46.052721 32766 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 03:27:46 dist-test-slave-2w3w krb5kdc[32514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246066, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.252@KRBTEST.COM for kudu/127.8.5.253@KRBTEST.COM
Aug 09 03:27:46 dist-test-slave-2w3w krb5kdc[32514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.254@KRBTEST.COM
I20260809 03:27:46.060439 303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:46.052963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.253:35077 (local address 127.0.0.1:50810)
0809 03:27:46.053033 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:46.053042 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:46.053079 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:46.053207 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:46.053208 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:46.053344 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:46.053380 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:46.053382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.054211 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.054212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:46.055028 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:46.055031 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.055471 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.055472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:46.055529 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:46.055930 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:46.055934 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:46.057236 (+ 1302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:46.059373 (+ 2137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:46.059374 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:46.059375 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:46.059572 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:46.059761 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:46.059761 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:46.059762 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:46.059857 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:46.060137 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:46.060137 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:46.060192 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 03:27:46.060266 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 03:27:46.060364 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 03:27:46.060511 32691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:46.053034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50810 (local address 127.8.5.253:35077)
0809 03:27:46.053074 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.053076 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.053084 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:27:46.053149 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.053150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.053157 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.053201 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.053449 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.054136 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.055090 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.055405 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.055463 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:46.057338 (+ 1875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:46.057340 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:46.057341 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:46.057348 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:46.059290 (+ 1942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.059646 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.059647 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.059647 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.059694 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.059926 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.059927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.059928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.060064 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:46.060140 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:46.060294 (+ 154us) server_negotiation.cc:299] Negotiation successful
0809 03:27:46.060393 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 03:27:46.060814 32766 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } has no permanent_uuid. Determining permanent_uuid...
I20260809 03:27:46.061157 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:46.052577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52046 (local address 127.8.5.254:43761)
0809 03:27:46.052638 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.052640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.052666 (+ 26us) server_negotiation.cc:407] Connection header received
0809 03:27:46.052688 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.052689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.052698 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.052761 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.053381 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.054084 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.055090 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.055377 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.055450 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:46.058132 (+ 2682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:46.058163 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:46.058163 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:46.058170 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:46.059845 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.060206 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.060207 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.060207 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.060266 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.060483 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.060484 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.060484 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.060623 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:46.060770 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:46.060983 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 03:27:46.061059 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 03:27:46.064718 32606 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } attempt: 2
Aug 09 03:27:46 dist-test-slave-2w3w krb5kdc[32514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246066, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.252@KRBTEST.COM for kudu/127.8.5.252@KRBTEST.COM
Aug 09 03:27:46 dist-test-slave-2w3w krb5kdc[32514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.5.253@KRBTEST.COM
I20260809 03:27:46.068591 303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:46.061081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:35065 (local address 127.0.0.1:60978)
0809 03:27:46.061157 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:46.061166 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:46.061208 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:46.061363 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:46.061363 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:46.061494 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:46.061540 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:46.061542 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.062234 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.062235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:46.062836 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:46.062838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.063307 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.063309 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:46.063371 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:46.063786 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:46.063791 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:46.065132 (+ 1341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:46.067536 (+ 2404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:46.067537 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:46.067537 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:46.067737 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:46.067942 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:46.067944 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:46.067945 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:46.067993 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:46.068306 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:46.068307 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:46.068354 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 03:27:46.068415 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 03:27:46.068493 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 03:27:46.068862 302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:46.061122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60978 (local address 127.8.5.252:35065)
0809 03:27:46.061161 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.061163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.061196 (+ 33us) server_negotiation.cc:407] Connection header received
0809 03:27:46.061280 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.061281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.061290 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.061326 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.061607 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.062155 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.062910 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.063237 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.063287 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:46.065219 (+ 1932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:46.065221 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:46.065222 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:46.065228 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:46.067454 (+ 2226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.067804 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.067805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.067806 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.067870 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.068055 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.068056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.068057 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.068216 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:46.068283 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:46.068709 (+ 426us) server_negotiation.cc:299] Negotiation successful
0809 03:27:46.068781 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 09 03:27:46 dist-test-slave-2w3w krb5kdc[32514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246065, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.254@KRBTEST.COM for kudu/127.8.5.252@KRBTEST.COM
I20260809 03:27:46.069530 32691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:46.061844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50820 (local address 127.8.5.253:35077)
0809 03:27:46.061899 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.061901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.061909 (+ 8us) server_negotiation.cc:407] Connection header received
0809 03:27:46.061928 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.061929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.061936 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.061980 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.062520 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.063047 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.063818 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.064013 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.064069 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:46.066568 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:46.066569 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:46.066570 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:46.066577 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:46.068211 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.068569 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.068570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.068571 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.068623 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.068915 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.068916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.068916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.069047 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:46.069174 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:46.069374 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 03:27:46.069443 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 03:27:46.070904 32766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133: Bootstrap starting.
I20260809 03:27:46.071017 8215 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 03:27:46.071749 32766 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:46.072098 32766 log.cc:824] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:46.072535 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:46.065017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:35065 (local address 127.0.0.1:60986)
0809 03:27:46.065062 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:46.065071 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:46.065109 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:46.065373 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:46.065374 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:46.065553 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:46.065594 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:46.065595 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.066630 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.066631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:46.067297 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:46.067300 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.067728 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.067729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:46.067789 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:46.068216 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:46.068221 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:46.069590 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:46.071431 (+ 1841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:46.071432 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:46.071433 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:46.071597 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:46.071839 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:46.071840 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:46.071840 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:46.071931 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:46.072199 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:46.072200 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:46.072243 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 03:27:46.072341 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 03:27:46.072436 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 03:27:46.072570 304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:46.065058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60986 (local address 127.8.5.252:35065)
0809 03:27:46.065233 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.065234 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.065240 (+ 6us) server_negotiation.cc:407] Connection header received
0809 03:27:46.065256 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.065257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.065267 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.065345 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.065666 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.066531 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.067396 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.067633 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.067725 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:46.069665 (+ 1940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:46.069666 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:46.069667 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:46.069673 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:46.071343 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.071668 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.071669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.071669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.071723 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.072013 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.072013 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.072014 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.072122 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:46.072194 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:46.072368 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 03:27:46.072438 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":96,"threads_started":1}
I20260809 03:27:46.072868 32766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133: No bootstrap required, opened a new log
I20260809 03:27:46.072018 32577 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "5ddb44541d614d82af5450344f2ad2ee"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52046
I20260809 03:27:46.073971 32606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee: Bootstrap starting.
I20260809 03:27:46.074625 32606 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:46.074657 32766 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } } peers { permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } } peers { permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } }
I20260809 03:27:46.074868 32766 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ce6faacaf43407fa82e7b89313ab133, State: Initialized, Role: FOLLOWER
I20260809 03:27:46.074918 32606 log.cc:824] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:46.074978 32766 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } } peers { permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } } peers { permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } }
I20260809 03:27:46.075268 307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } } peers { permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } } peers { permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } } }
I20260809 03:27:46.075337 32766 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:46.075358 307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:27:46.075717 32606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee: No bootstrap required, opened a new log
I20260809 03:27:46.077317 32606 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } } peers { permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } } peers { permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } }
I20260809 03:27:46.077453 32606 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ddb44541d614d82af5450344f2ad2ee, State: Initialized, Role: FOLLOWER
I20260809 03:27:46.077528 32606 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } } peers { permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } } peers { permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } }
W20260809 03:27:46.077688 318 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:27:46.077733 318 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:27:46.077816 32606 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:46.077857 320 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } } peers { permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } } peers { permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } } }
I20260809 03:27:46.077932 320 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [sys.catalog]: This master's current role is: FOLLOWER
W20260809 03:27:46.079540 332 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:27:46.079584 332 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:27:46.077574 32694 master_runner.cc:186] Error getting master registration for 127.8.5.254:43761: OK, instance_id { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" instance_seqno: 1786246065721166 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 03:27:46.080082 32694 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 03:27:46.080216 32577 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 03:27:46.080289 32577 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:46.081115 32577 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } } peers { permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } } peers { permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } }
I20260809 03:27:46.081322 32577 leader_election.cc:288] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [CANDIDATE]: Term 1 election: Requested vote from peers 412fd357893946319941ae72d655cb65 (127.8.5.253:35077), 8ce6faacaf43407fa82e7b89313ab133 (127.8.5.252:35065)
I20260809 03:27:46.080224 32527 master_runner.cc:186] Error getting master registration for 127.8.5.253:35077: OK, instance_id { permanent_uuid: "412fd357893946319941ae72d655cb65" instance_seqno: 1786246065878263 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 03:27:46.082587 32527 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 03:27:46.082932 32739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5ddb44541d614d82af5450344f2ad2ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8ce6faacaf43407fa82e7b89313ab133"
I20260809 03:27:46.083081 32739 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:46.084012 32739 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ddb44541d614d82af5450344f2ad2ee in term 1.
I20260809 03:27:46.084661 32548 leader_election.cc:302] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ddb44541d614d82af5450344f2ad2ee, 8ce6faacaf43407fa82e7b89313ab133; no voters:
I20260809 03:27:46.084785 320 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [term 1 FOLLOWER]: Leader election won for term 1
I20260809 03:27:46.085016 320 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [term 1 LEADER]: Becoming Leader. State: Replica: 5ddb44541d614d82af5450344f2ad2ee, State: Running, Role: LEADER
I20260809 03:27:46.085121 320 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } } peers { permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } } peers { permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } }
I20260809 03:27:46.085527 320 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ddb44541d614d82af5450344f2ad2ee. Latest consensus state: current_term: 1 leader_uuid: "5ddb44541d614d82af5450344f2ad2ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } } peers { permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } } peers { permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } } }
I20260809 03:27:46.085619 320 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:46.090430 32691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:46.082719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50822 (local address 127.8.5.253:35077)
0809 03:27:46.082791 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.082793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.082951 (+ 158us) server_negotiation.cc:407] Connection header received
0809 03:27:46.083073 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.083074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.083086 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.083117 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.083932 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.084500 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.085614 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.085903 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.085952 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:46.087551 (+ 1599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:46.087552 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:46.087553 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:46.087559 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:46.089210 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.089574 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.089575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.089576 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.089627 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.089853 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.089854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.089854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.089960 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:46.090077 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:46.090196 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 03:27:46.090286 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 03:27:46.093720 345 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 03:27:46.094226 345 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 03:27:46.096897 32739 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133 [term 1 FOLLOWER]: Refusing update from remote peer 5ddb44541d614d82af5450344f2ad2ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:27:46.097340 343 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:27:46.098239 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:46.082659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52060 (local address 127.8.5.254:43761)
0809 03:27:46.082701 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.082703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.090472 (+ 7769us) server_negotiation.cc:407] Connection header received
0809 03:27:46.090580 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.090581 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.090593 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.090625 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.091302 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.091741 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.092678 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.092884 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.092971 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:46.094339 (+ 1368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:46.094340 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:46.094340 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:46.094355 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:46.096080 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.096495 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.096497 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.096498 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.096556 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.097460 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.097461 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.097461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.097608 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:46.097683 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:46.098056 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 03:27:46.098145 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 03:27:46.099510 307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ddb44541d614d82af5450344f2ad2ee. Latest consensus state: current_term: 1 leader_uuid: "5ddb44541d614d82af5450344f2ad2ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } } peers { permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } } peers { permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } } }
I20260809 03:27:46.099601 307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:27:46.100396 304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:46.082754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60990 (local address 127.8.5.252:35065)
0809 03:27:46.082830 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.082832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.090941 (+ 8109us) server_negotiation.cc:407] Connection header received
0809 03:27:46.091086 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.091087 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.091099 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.091129 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.091875 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.092622 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.095137 (+ 2515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.095482 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.095523 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:46.097509 (+ 1986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:46.097511 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:46.097511 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:46.097518 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:46.099192 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.099570 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.099571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.099571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.099623 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.099810 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.099811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.099812 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.099943 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:46.100027 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:46.100227 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 03:27:46.100306 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 03:27:46.101104 320 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5ddb44541d614d82af5450344f2ad2ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } } peers { permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } } peers { permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } } }
I20260809 03:27:46.101190 320 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:46.101269 346 mvcc.cc:205] Tried to move back new op lower bound from 7316463886729273344 to 7316463886685384704. Current Snapshot: MvccSnapshot[applied={T|T < 7316463886729273344}]
I20260809 03:27:46.101368 307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5ddb44541d614d82af5450344f2ad2ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } } peers { permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } } peers { permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } } }
I20260809 03:27:46.101452 307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:27:46.101861 349 mvcc.cc:205] Tried to move back new op lower bound from 7316463886729273344 to 7316463886685384704. Current Snapshot: MvccSnapshot[applied={T|T < 7316463886729273344}]
I20260809 03:27:46.104286 345 catalog_manager.cc:1347] Generated new cluster ID: 89c6be85ec0c44c993ea54643bfe1c69
I20260809 03:27:46.104336 345 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 03:27:46.112325 32686 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } attempt: 3
Aug 09 03:27:46 dist-test-slave-2w3w krb5kdc[32514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786246065, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.5.253@KRBTEST.COM for kudu/127.8.5.252@KRBTEST.COM
I20260809 03:27:46.120865 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:46.112593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.5.252:35065 (local address 127.0.0.1:32768)
0809 03:27:46.112678 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0809 03:27:46.112689 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 03:27:46.112729 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 03:27:46.113075 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 03:27:46.113076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 03:27:46.113264 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0809 03:27:46.113326 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:46.113328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.114255 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.114256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:46.115093 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 03:27:46.115096 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.115603 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.115604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 03:27:46.115672 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:46.116211 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 03:27:46.116216 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 03:27:46.117724 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 03:27:46.119732 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:46.119734 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:46.119734 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:46.119960 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:46.120192 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 03:27:46.120192 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 03:27:46.120193 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 03:27:46.120260 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 03:27:46.120551 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 03:27:46.120552 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 03:27:46.120592 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 03:27:46.120653 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 03:27:46.120750 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 03:27:46.121215 304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:46.112803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32768 (local address 127.8.5.252:35065)
0809 03:27:46.112851 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.112854 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.112861 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:27:46.112881 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.112882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.112891 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.112952 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.113415 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.114157 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.115177 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:46.115474 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:46.115534 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:46.117806 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 03:27:46.117807 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 03:27:46.117808 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 03:27:46.117815 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 03:27:46.119650 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.120050 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.120051 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.120052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.120127 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 03:27:46.120334 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 03:27:46.120336 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 03:27:46.120336 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 03:27:46.120467 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 03:27:46.120526 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:46.121047 (+ 521us) server_negotiation.cc:299] Negotiation successful
0809 03:27:46.121127 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 03:27:46.122852 32686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65: Bootstrap starting.
I20260809 03:27:46.123675 32686 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65: Neither blocks nor log segments found. Creating new log.
I20260809 03:27:46.123979 32686 log.cc:824] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65: Log is configured to *not* fsync() on all Append() calls
I20260809 03:27:46.131595 32686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65: No bootstrap required, opened a new log
I20260809 03:27:46.133569 32686 raft_consensus.cc:348] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } } peers { permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } } peers { permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } }
I20260809 03:27:46.133714 32686 raft_consensus.cc:729] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 412fd357893946319941ae72d655cb65, State: Initialized, Role: FOLLOWER
I20260809 03:27:46.133798 32686 consensus_queue.cc:260] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } } peers { permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } } peers { permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } }
I20260809 03:27:46.134157 32686 sys_catalog.cc:564] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 03:27:46.134177 32658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5ddb44541d614d82af5450344f2ad2ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "412fd357893946319941ae72d655cb65"
I20260809 03:27:46.134310 32658 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65 [term 0 FOLLOWER]: Advancing to term 1
I20260809 03:27:46.136793 32658 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ddb44541d614d82af5450344f2ad2ee in term 1.
I20260809 03:27:46.137328 32657 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65 [term 1 FOLLOWER]: Refusing update from remote peer 5ddb44541d614d82af5450344f2ad2ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 03:27:46.138266 343 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 03:27:46.141366 354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } } peers { permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } } peers { permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } } }
I20260809 03:27:46.141510 354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:27:46.142448 354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ddb44541d614d82af5450344f2ad2ee. Latest consensus state: current_term: 1 leader_uuid: "5ddb44541d614d82af5450344f2ad2ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } } peers { permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } } peers { permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } } }
I20260809 03:27:46.142570 354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 03:27:46.142642 354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5ddb44541d614d82af5450344f2ad2ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } } peers { permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } } peers { permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } } }
I20260809 03:27:46.142730 354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 03:27:46.143396 366 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 03:27:46.143553 366 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 03:27:46.146925 345 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 03:27:46.147385 368 mvcc.cc:205] Tried to move back new op lower bound from 7316463886729273344 to 7316463886685384704. Current Snapshot: MvccSnapshot[applied={T|T < 7316463886729273344}]
I20260809 03:27:46.147910 345 catalog_manager.cc:1504] Loading token signing keys...
I20260809 03:27:46.148159 343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5ddb44541d614d82af5450344f2ad2ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ddb44541d614d82af5450344f2ad2ee" member_type: VOTER last_known_addr { host: "127.8.5.254" port: 43761 } } peers { permanent_uuid: "412fd357893946319941ae72d655cb65" member_type: VOTER last_known_addr { host: "127.8.5.253" port: 35077 } } peers { permanent_uuid: "8ce6faacaf43407fa82e7b89313ab133" member_type: VOTER last_known_addr { host: "127.8.5.252" port: 35065 } } }
I20260809 03:27:46.148262 343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee [sys.catalog]: This master's current role is: LEADER
I20260809 03:27:46.166795 345 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ddb44541d614d82af5450344f2ad2ee: Generated new TSK 0
I20260809 03:27:46.167063 345 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 03:27:46.201009 32691 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:46.199294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50824 (local address 127.8.5.253:35077)
0809 03:27:46.199352 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.199354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.200305 (+ 951us) server_negotiation.cc:407] Connection header received
0809 03:27:46.200431 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.200432 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.200444 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.200474 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.200924 (+ 450us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50824: BlockingRecv error: recv got EOF from 127.0.0.1:50824 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260809 03:27:46.201777 32609 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:46.199549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52062 (local address 127.8.5.254:43761)
0809 03:27:46.199587 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.199589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.201225 (+ 1636us) server_negotiation.cc:407] Connection header received
0809 03:27:46.201322 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.201323 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.201334 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.201374 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.201718 (+ 344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52062: BlockingRecv error: recv got EOF from 127.0.0.1:52062 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 03:27:46.202503 304 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:46.199914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32770 (local address 127.8.5.252:35065)
0809 03:27:46.199956 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.199958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.202005 (+ 2047us) server_negotiation.cc:407] Connection header received
0809 03:27:46.202100 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.202101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.202112 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.202142 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.202446 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32770: BlockingRecv error: recv got EOF from 127.0.0.1:32770 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260809 03:27:46.204746 32691 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:46.204053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50834 (local address 127.8.5.253:35077)
0809 03:27:46.204110 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.204112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.204248 (+ 136us) server_negotiation.cc:407] Connection header received
0809 03:27:46.204362 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.204363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.204381 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.204410 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.204703 (+ 293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50834: BlockingRecv error: recv got EOF from 127.0.0.1:50834 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260809 03:27:46.211665 32691 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:46.207282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50848 (local address 127.8.5.253:35077)
0809 03:27:46.207338 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.207340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.211141 (+ 3801us) server_negotiation.cc:407] Connection header received
0809 03:27:46.211240 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.211242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.211252 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.211281 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.211606 (+ 325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50848: BlockingRecv error: recv got EOF from 127.0.0.1:50848 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260809 03:27:46.215663 32691 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:46.214722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50858 (local address 127.8.5.253:35077)
0809 03:27:46.214788 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.214789 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.215161 (+ 372us) server_negotiation.cc:407] Connection header received
0809 03:27:46.215258 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.215259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.215270 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.215298 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.215617 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50858: BlockingRecv error: recv got EOF from 127.0.0.1:50858 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260809 03:27:46.224108 32691 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:46.223259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50862 (local address 127.8.5.253:35077)
0809 03:27:46.223298 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.223300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.223582 (+ 282us) server_negotiation.cc:407] Connection header received
0809 03:27:46.223679 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.223680 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.223690 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.223718 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.224058 (+ 340us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50862: BlockingRecv error: recv got EOF from 127.0.0.1:50862 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 03:27:46.234338 32691 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:46.233415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50876 (local address 127.8.5.253:35077)
0809 03:27:46.233459 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.233461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.233715 (+ 254us) server_negotiation.cc:407] Connection header received
0809 03:27:46.233823 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.233824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.233836 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.233867 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.234283 (+ 416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50876: BlockingRecv error: recv got EOF from 127.0.0.1:50876 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260809 03:27:46.252686 32691 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:46.251757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50890 (local address 127.8.5.253:35077)
0809 03:27:46.251800 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.251803 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.252064 (+ 261us) server_negotiation.cc:407] Connection header received
0809 03:27:46.252171 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.252172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.252184 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.252216 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.252627 (+ 411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50890: BlockingRecv error: recv got EOF from 127.0.0.1:50890 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260809 03:27:46.287006 32691 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:46.286152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50906 (local address 127.8.5.253:35077)
0809 03:27:46.286201 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.286203 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.286372 (+ 169us) server_negotiation.cc:407] Connection header received
0809 03:27:46.286430 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.286431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.286444 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.286513 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.286909 (+ 396us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50906: BlockingRecv error: recv got EOF from 127.0.0.1:50906 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260809 03:27:46.353048 32691 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:46.352245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50908 (local address 127.8.5.253:35077)
0809 03:27:46.352334 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.352337 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.352442 (+ 105us) server_negotiation.cc:407] Connection header received
0809 03:27:46.352547 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.352549 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.352562 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.352631 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.352979 (+ 348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50908: BlockingRecv error: recv got EOF from 127.0.0.1:50908 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260809 03:27:46.483028 32691 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:46.482177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50910 (local address 127.8.5.253:35077)
0809 03:27:46.482262 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.482265 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.482369 (+ 104us) server_negotiation.cc:407] Connection header received
0809 03:27:46.482471 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.482472 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.482485 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.482562 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.482922 (+ 360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50910: BlockingRecv error: recv got EOF from 127.0.0.1:50910 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 03:27:46.741108 32691 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 03:27:46.740294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50924 (local address 127.8.5.253:35077)
0809 03:27:46.740395 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:46.740397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:46.740410 (+ 13us) server_negotiation.cc:407] Connection header received
0809 03:27:46.740521 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:46.740522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:46.740537 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:46.740622 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 03:27:46.741036 (+ 414us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50924: BlockingRecv error: recv got EOF from 127.0.0.1:50924 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 03:27:47.078212 318 catalog_manager.cc:1259] Loaded cluster ID: 89c6be85ec0c44c993ea54643bfe1c69
I20260809 03:27:47.078292 318 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133: loading cluster ID for follower catalog manager: success
I20260809 03:27:47.079412 318 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133: acquiring CA information for follower catalog manager: success
I20260809 03:27:47.079766 318 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8ce6faacaf43407fa82e7b89313ab133: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 03:27:47.144176 366 catalog_manager.cc:1259] Loaded cluster ID: 89c6be85ec0c44c993ea54643bfe1c69
I20260809 03:27:47.144274 366 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65: loading cluster ID for follower catalog manager: success
I20260809 03:27:47.145939 366 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65: acquiring CA information for follower catalog manager: success
I20260809 03:27:47.146461 366 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 412fd357893946319941ae72d655cb65: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 03:27:47.256983 442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:47.254381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50936 (local address 127.8.5.253:35077)
0809 03:27:47.254508 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:47.254509 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:47.254534 (+ 25us) server_negotiation.cc:407] Connection header received
0809 03:27:47.254607 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:47.254608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:47.254663 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:47.254760 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:27:47.254901 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:47.255478 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:47.256242 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:47.256439 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:47.256490 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:47.256623 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:27:47.256749 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:27:47.256825 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:47.256897 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 03:27:47.256915 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":76,"threads_started":1}
I20260809 03:27:47.261133 449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:47.258809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32780 (local address 127.8.5.252:35065)
0809 03:27:47.258932 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:47.258934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:47.259013 (+ 79us) server_negotiation.cc:407] Connection header received
0809 03:27:47.259061 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:47.259062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:47.259110 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:47.259190 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:27:47.259326 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:47.259783 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:47.260528 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:47.260717 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:47.260770 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:47.260886 (+ 116us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:27:47.260971 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:27:47.261021 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:47.261057 (+ 36us) server_negotiation.cc:299] Negotiation successful
0809 03:27:47.261073 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":80,"threads_started":1}
I20260809 03:27:47.265733 449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:47.263231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32784 (local address 127.8.5.252:35065)
0809 03:27:47.263276 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:47.263278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:47.263285 (+ 7us) server_negotiation.cc:407] Connection header received
0809 03:27:47.263307 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:47.263308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:47.263317 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:47.263376 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:27:47.263539 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:47.264220 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:47.265009 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:47.265270 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:47.265332 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:47.265479 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:27:47.265512 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:27:47.265572 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:47.265619 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 03:27:47.265638 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 03:27:47.265990 442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:47.262842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50944 (local address 127.8.5.253:35077)
0809 03:27:47.262881 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:47.262883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:47.263040 (+ 157us) server_negotiation.cc:407] Connection header received
0809 03:27:47.263148 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:47.263149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:47.263160 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:47.263191 (+ 31us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:27:47.263409 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:47.264171 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:47.265187 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:47.265482 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:47.265543 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:47.265730 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:27:47.265762 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:27:47.265791 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:47.265909 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 03:27:47.265930 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 03:27:47.266264 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 03:27:47.262823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52066 (local address 127.8.5.254:43761)
0809 03:27:47.262936 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 03:27:47.262938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 03:27:47.262992 (+ 54us) server_negotiation.cc:407] Connection header received
0809 03:27:47.263136 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 03:27:47.263137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 03:27:47.263196 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 03:27:47.263281 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 03:27:47.263422 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:47.263957 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:47.264998 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 03:27:47.265280 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 03:27:47.265361 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 03:27:47.265560 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 03:27:47.265659 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 03:27:47.265720 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 03:27:47.265985 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 03:27:47.266017 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":60,"threads_started":1}
I20260809 03:27:47.272570 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 32527
I20260809 03:27:47.280581 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 32613
I20260809 03:27:47.287037 8215 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdTui8C/build/release/bin/kudu with pid 32694
2026-08-09T03:27:47Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2928 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5822 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (269860 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST